Journal article Open Access

# Characterizing Task-Relevant Information in Natural Language Software Artifacts

Marques, Arthur; Bradley, Nick C.; Murphy, Gail C.

### DataCite XML Export

<?xml version='1.0' encoding='utf-8'?>
<identifier identifierType="DOI">10.5281/zenodo.3839075</identifier>
<creators>
<creator>
<creatorName>Marques, Arthur</creatorName>
<givenName>Arthur</givenName>
<familyName>Marques</familyName>
<affiliation>University of British Columbia</affiliation>
</creator>
<creator>
<givenName>Nick C.</givenName>
<affiliation>University of British Columbia</affiliation>
</creator>
<creator>
<creatorName>Murphy, Gail C.</creatorName>
<givenName>Gail C.</givenName>
<familyName>Murphy</familyName>
<affiliation>University of British Columbia</affiliation>
</creator>
</creators>
<titles>
<title>Characterizing Task-Relevant Information in Natural Language Software Artifacts</title>
</titles>
<publisher>Zenodo</publisher>
<publicationYear>2020</publicationYear>
<dates>
<date dateType="Issued">2020-05-22</date>
</dates>
<resourceType resourceTypeGeneral="JournalArticle"/>
<alternateIdentifiers>
<alternateIdentifier alternateIdentifierType="url">https://zenodo.org/record/3839075</alternateIdentifier>
</alternateIdentifiers>
<relatedIdentifiers>
<relatedIdentifier relatedIdentifierType="DOI" relationType="IsVersionOf">10.5281/zenodo.3839074</relatedIdentifier>
<relatedIdentifier relatedIdentifierType="URL" relationType="IsPartOf">https://zenodo.org/communities/empirical-software-engineering</relatedIdentifier>
</relatedIdentifiers>
<version>1</version>
<rightsList>
<rights rightsURI="info:eu-repo/semantics/openAccess">Open Access</rights>
</rightsList>
<descriptions>
<description descriptionType="Abstract">&lt;p&gt;Contains the supplementary material for the paper &amp;quot;Characterizing Task-Relevant Information&lt;br&gt;
in Natural Language Software Artifacts&amp;quot;. All contents are explained in the file README.md.&lt;/p&gt;

&lt;p&gt;&amp;nbsp;&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Abstract:&lt;/strong&gt; To complete a software development task, a software developer often consults artifacts that contain largely natural language text, such as API documentation, bug reports, or Q&amp;amp;A forums.&amp;nbsp; Not all information within these artifacts is relevant to a developer&amp;#39;s current task forcing the developer to filter relevant information from large amounts of irrelevant information, a frustrating and time-consuming activity.&amp;nbsp; Since failing to locate relevant information may lead to incorrect or incomplete solutions, many approaches mine potentially relevant text from such natural language artifacts. However, existing approaches identify text relevant for only certain categories of tasks (e.g., learning an API) and from a restricted set of artifact types. To explore how limitations on software development tasks and artifact types can be relaxed in future approaches, we conducted an experiment in which 20 participants identified which text appearing in 1874 sentences across 20 artifacts was relevant to six software development tasks. Participants created 2,463 distinct highlights in these sentences to indicate relevance. Although the results indicate variability in the text perceived as relevant, we observe consistency in the information considered &lt;em&gt;key&lt;/em&gt; for task completion. The semantic meaning of relevant information, as identified through semantic frames, shows promise to automate the identification of relevant text. We discuss implications of our study for future research in the field.&lt;/p&gt;</description>
</descriptions>
</resource>

117
16
views