Conference paper Open Access

# On the importance of deep learning regularization techniques in knowledge discovery

Ljubinka Sandjakoska; Atanas Hristov; Ana Madevska Bogdanova

### DataCite XML Export

<?xml version='1.0' encoding='utf-8'?>
<identifier identifierType="DOI">10.5281/zenodo.1447168</identifier>
<creators>
<creator>
<creatorName>Ljubinka Sandjakoska</creatorName>
<affiliation>UIST St Paul the Apostle</affiliation>
</creator>
<creator>
<creatorName>Atanas Hristov</creatorName>
<affiliation>UIST St Paul the Apostle</affiliation>
</creator>
<creator>
<affiliation>Ss Cyril and Methodius University</affiliation>
</creator>
</creators>
<titles>
<title>On the importance of deep learning regularization techniques in knowledge discovery</title>
</titles>
<publisher>Zenodo</publisher>
<publicationYear>2018</publicationYear>
<dates>
<date dateType="Issued">2018-12-19</date>
</dates>
<resourceType resourceTypeGeneral="Text">Conference paper</resourceType>
<alternateIdentifiers>
<alternateIdentifier alternateIdentifierType="url">https://zenodo.org/record/1447168</alternateIdentifier>
</alternateIdentifiers>
<relatedIdentifiers>
<relatedIdentifier relatedIdentifierType="DOI" relationType="IsVersionOf">10.5281/zenodo.1447167</relatedIdentifier>
<relatedIdentifier relatedIdentifierType="URL" relationType="IsPartOf">https://zenodo.org/communities/bigskyearth-conference-2018</relatedIdentifier>
</relatedIdentifiers>
<rightsList>
<rights rightsURI="info:eu-repo/semantics/openAccess">Open Access</rights>
</rightsList>
<descriptions>
<description descriptionType="Abstract">&lt;p&gt;Nowadays, in the era of complex data, the knowledge discovery process became one of the key challenges in the science. The evolution of the technologies imply evolution of the techniques for dealing with the data. Deep neural networks, as advanced concepts became very popular and can be viewed as tool for improvement of knowledge discovery processes. A motivation for this paper is generalization ability of deep neural network. In an attempt to better understand and to solve the problem of generalization of deep neural networks, we study several regularization techniques. Different regularization techniques, as a solution of overfitting problem, are discussed. The impact of regularization on knowledge discovery process is in the focus of this paper. In order to illustrate the effect of regularization in knowledge discovery, a case study is presented. The case study refers to discovering unknown relationships between molecules in atomic simulation. We propose a dropout method for regularization deep neural network for molecular dynamics simulations. In this paper we show that discovering high level concepts in data, during knowledge discovery, is possible with efficient training of regularized deep neural networks.&lt;/p&gt;</description>
</descriptions>
</resource>

72
75
views