PURE: a Dataset of Public Requirements Documents

Please cite this dataset as Ferrari, A., Spagnolo, G. O., & Gnesi, S. (2017, September). PURE: A dataset of public requirements documents. In 2017 IEEE 25th International Requirements Engineering Conference (RE) (pp. 502-505). IEEE.

https://ieeexplore.ieee.org/abstract/document/8049173

This dataset presents PURE (PUblic REquirements dataset), a dataset of 79 publicly available natural language requirements documents collected from the Web. The dataset includes 34,268 sentences and can be used for natural language processing tasks that are typical in requirements engineering, such as model synthesis, abstraction identification and document structure assessment. It can be further annotated to work as a benchmark for other tasks, such as ambiguity detection, requirements categorisation and identification of equivalent re-quirements. In the associated paper, we present the dataset and we compare its language with generic English texts, showing the peculiarities of the requirements jargon, made of a restricted vocabulary of domain-specific acronyms and words, and long sentences. We also present the common XML format to which we have manually ported a subset of the documents, with the goal of facilitating replication of NLP experiments. The XML documents are also available for download.

The paper associated to the dataset can be found here: 

https://ieeexplore.ieee.org/document/8049173/

More info about the dataset is available here: 

http://nlreqdataset.isti.cnr.it

Preprint of the paper available at ResearchGate:

https://goo.gl/HxJD7X

The dataset includes:

- all the documents in PDF format

- a subset of 19 documents in XML format

- the .xsd schema of the XML files