Dataset Open Access
War of Words II: Enriched Models of Law-Making Processes
Kristof, Victor; Suresh, Aswin; Grossglauser, Matthias; Thiran, Patrick
DCAT Export
<?xml version='1.0' encoding='utf-8'?>
<rdf:RDF xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:adms="http://www.w3.org/ns/adms#" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:dct="http://purl.org/dc/terms/" xmlns:dctype="http://purl.org/dc/dcmitype/" xmlns:dcat="http://www.w3.org/ns/dcat#" xmlns:duv="http://www.w3.org/ns/duv#" xmlns:foaf="http://xmlns.com/foaf/0.1/" xmlns:frapo="http://purl.org/cerif/frapo/" xmlns:geo="http://www.w3.org/2003/01/geo/wgs84_pos#" xmlns:gsp="http://www.opengis.net/ont/geosparql#" xmlns:locn="http://www.w3.org/ns/locn#" xmlns:org="http://www.w3.org/ns/org#" xmlns:owl="http://www.w3.org/2002/07/owl#" xmlns:prov="http://www.w3.org/ns/prov#" xmlns:rdfs="http://www.w3.org/2000/01/rdf-schema#" xmlns:schema="http://schema.org/" xmlns:skos="http://www.w3.org/2004/02/skos/core#" xmlns:vcard="http://www.w3.org/2006/vcard/ns#" xmlns:wdrs="http://www.w3.org/2007/05/powder-s#">
<rdf:Description rdf:about="https://doi.org/10.5281/zenodo.4525015">
<rdf:type rdf:resource="http://www.w3.org/ns/dcat#Dataset"/>
<dct:type rdf:resource="http://purl.org/dc/dcmitype/Dataset"/>
<dct:identifier rdf:datatype="http://www.w3.org/2001/XMLSchema#anyURI">https://doi.org/10.5281/zenodo.4525015</dct:identifier>
<foaf:page rdf:resource="https://doi.org/10.5281/zenodo.4525015"/>
<dct:creator>
<rdf:Description>
<rdf:type rdf:resource="http://xmlns.com/foaf/0.1/Agent"/>
<foaf:name>Kristof, Victor</foaf:name>
<foaf:givenName>Victor</foaf:givenName>
<foaf:familyName>Kristof</foaf:familyName>
<org:memberOf>
<foaf:Organization>
<foaf:name>EPFL</foaf:name>
</foaf:Organization>
</org:memberOf>
</rdf:Description>
</dct:creator>
<dct:creator>
<rdf:Description>
<rdf:type rdf:resource="http://xmlns.com/foaf/0.1/Agent"/>
<foaf:name>Suresh, Aswin</foaf:name>
<foaf:givenName>Aswin</foaf:givenName>
<foaf:familyName>Suresh</foaf:familyName>
<org:memberOf>
<foaf:Organization>
<foaf:name>EPFL</foaf:name>
</foaf:Organization>
</org:memberOf>
</rdf:Description>
</dct:creator>
<dct:creator>
<rdf:Description>
<rdf:type rdf:resource="http://xmlns.com/foaf/0.1/Agent"/>
<foaf:name>Grossglauser, Matthias</foaf:name>
<foaf:givenName>Matthias</foaf:givenName>
<foaf:familyName>Grossglauser</foaf:familyName>
<org:memberOf>
<foaf:Organization>
<foaf:name>EPFL</foaf:name>
</foaf:Organization>
</org:memberOf>
</rdf:Description>
</dct:creator>
<dct:creator>
<rdf:Description>
<rdf:type rdf:resource="http://xmlns.com/foaf/0.1/Agent"/>
<foaf:name>Thiran, Patrick</foaf:name>
<foaf:givenName>Patrick</foaf:givenName>
<foaf:familyName>Thiran</foaf:familyName>
<org:memberOf>
<foaf:Organization>
<foaf:name>EPFL</foaf:name>
</foaf:Organization>
</org:memberOf>
</rdf:Description>
</dct:creator>
<dct:title>War of Words II: Enriched Models of Law-Making Processes</dct:title>
<dct:publisher>
<foaf:Agent>
<foaf:name>Zenodo</foaf:name>
</foaf:Agent>
</dct:publisher>
<dct:issued rdf:datatype="http://www.w3.org/2001/XMLSchema#gYear">2021</dct:issued>
<dcat:contactPoint>
<rdf:Description>
<rdf:type rdf:resource="http://www.w3.org/2006/vcard/ns#Individual"/>
<vcard:fn>Kristof, Victor</vcard:fn>
<vcard:given-name>Victor</vcard:given-name>
<vcard:family-name>Kristof</vcard:family-name>
<vcard:organization-name>EPFL</vcard:organization-name>
</rdf:Description>
</dcat:contactPoint>
<dcat:contactPoint>
<rdf:Description>
<rdf:type rdf:resource="http://www.w3.org/2006/vcard/ns#Individual"/>
<vcard:fn>Suresh, Aswin</vcard:fn>
<vcard:given-name>Aswin</vcard:given-name>
<vcard:family-name>Suresh</vcard:family-name>
<vcard:organization-name>EPFL</vcard:organization-name>
</rdf:Description>
</dcat:contactPoint>
<dct:issued rdf:datatype="http://www.w3.org/2001/XMLSchema#date">2021-04-19</dct:issued>
<owl:sameAs rdf:resource="https://zenodo.org/record/4525015"/>
<adms:identifier>
<adms:Identifier>
<skos:notation rdf:datatype="http://www.w3.org/2001/XMLSchema#anyURI">https://zenodo.org/record/4525015</skos:notation>
<adms:schemeAgency>url</adms:schemeAgency>
</adms:Identifier>
</adms:identifier>
<foaf:page rdf:resource="https://doi.org/10.1145/3442381.3450131"/>
<dct:relation rdf:resource="https://doi.org/10.1145/3366423.3380041"/>
<dct:isVersionOf rdf:resource="https://doi.org/10.5281/zenodo.4525014"/>
<dct:isPartOf rdf:resource="https://zenodo.org/communities/epfl"/>
<owl:versionInfo>1.0</owl:versionInfo>
<dct:description><pre><code>@inproceedings{kristof2021war, author = {Kristof, Victor and Suresh, Aswin and Grossglauser, Matthias and Thiran, Patrick}, title = {War of Words II: Enriched Models for Law-Making Processes}, year = {2021}, booktitle = {Proceedings of The Web Conference 2021}, TODO: pages = {2803–2809}, numpages = {12}, location = {Ljubljana, Solvenia}, series = {WWW '21} }</code></pre> <p>This upload contains the dataset presented and used in the paper:</p> <blockquote> <p>Victor Kristof, Aswin Suresh, Matthias Grossglauser, Patrick Thiran, <a href="https://infoscience.epfl.ch/record/284828">War of Words II: Enriched Models of Law-Making Processes</a>,&nbsp;The Web Conference 2021, April 19-23, 2021, Ljubljana, Slovenia</p> </blockquote> <p>The code to process and use the dataset can be found on&nbsp;<a href="https://github.com/indy-lab/war-of-words">GitHub</a>.</p> <p>This is a follow-up work to&nbsp;<em><a href="https://zenodo.org/record/3757714">War of Words: The Competitive Dynamics of Legislative Processes</a>.</em></p> <p>The dataset is split into two legislature periods of the European Parliament, the 7th (<strong>war-of-words-2-ep7.txt</strong>) and the 8th (<strong>war-of-words-2-ep8.txt</strong>) legislature.&nbsp;Here is a snippet to load the dataset (for EP8&nbsp;in this example) in Python:</p> <pre><code class="language-python">import json with open('path/to/war-of-words-2-ep8.txt') as f: dataset = [json.loads(l) for l in f.readlines()] </code></pre> <p>In the two text files, each line is a data point representing a&nbsp;<em>conflict between edits</em>. It is encoded as a JSON list of dictionaries, where each dictionary is an edit.&nbsp;Each edit has the following structure:</p> <pre><code class="language-json">{ 'edit_id': 163187, // Unique edit identifier 'edit_type': 'insert', // One of 'insert', 'delete', or 'replace' 'accepted': True, // Label 'dossier_ref': 'ENVI-AD(2012)487738', // Reference to dossier (see below) 'dossier_type': 'opinion', // One of 'opinion' or 'report' 'date': '2017-03-02', // Date of vote of all amendments for this dossier 'legal_act': 'regulation', // One of 'regulation', 'directive', or 'decision' 'committee': 'BUDG', // Committee in which this edit was proposed 'outsider': False, // Whether the above committee is the reporting committee 'article_type': 'recital', // One of 7 article types 'source': 'BUDG-AM(2017)599742', // Reference to original document of the amendment 'justification': None, // The text of the optional justification (or None) 'edit_indices': {...}, // Indices of edit in the amendment (see below) 'text_original': [...], // Original text reported in the source document (see below) 'text_amended': [...], // Amended text reported in the source document (see below) 'authors': [ // List of authors { 'id': 88882, // Unique MEP identifier (see below) 'name': 'Victor NEGRESCU', // MEP full name 'gender': 'M', // Gender as reported on the Parliament database 'nationality': 'Romania', // One of 28 nationalities 'group': 'Group of the Progressive Alliance of Socialists and Democrats in the European Parliament', // One 9 political groups 'rapporteur': False // Whether the MEP is rapporteur for this dossier }, ], }</code></pre> <p>The <strong>text_original</strong>&nbsp;and <strong>text_amended</strong>&nbsp;keys contain the portion of text reported in the `source` document. The text is tokenized as a list of terms (words, numbers, punctuation, ...).&nbsp;<em>These two keys are not the actual edit.</em>&nbsp;This is because the amendments are reported as an edited paragraph (which also gives some context to the edit).&nbsp;An amendment contains one or more edits. To access the actual text of the edit, use the&nbsp;`edit_indices` key, which&nbsp;is a dictionary (such as `{&#39;i1&#39;: 80, &#39;i2&#39;: 80, &#39;j1&#39;: 80, &#39;j2&#39;: 101}`). The `i1` and `i2` keys are the first and last indices of the change in the original text, and the `j1` and `j2` keys are the first and last indices of the amended text. Hence, you can access the text of the edit by doing:</p> <pre><code class="language-python">idx = edit['edit_indices'] i1, i2, j1, j2 = idx['i1'], idx['i2'], idx['j1'], idx['j2'] old = edit['text_original'][i1:i2] new = edit['text_amended'][j1:j2] print(f'"{old}" is replaced by "{new}"')</code></pre> <p>If an edit is an insertion, then `i1 == i2`. If it is a deletion, then `j1 == j2`. Read the documentation of <a href="https://docs.python.org/3.6/library/difflib.html#difflib.SequenceMatcher.get_opcodes">difflib</a> to learn more about how these indices&nbsp;are obtained.</p> <p>You can assume that:</p> <ul> <li>Each data point has at least one edit.</li> <li>If there is only one edit, then it is&nbsp;<em>in conflict with the status quo&nbsp;</em>(see Section 2&nbsp;of the paper).</li> <li>If there are two or more edits in conflict, then they are all in conflict against each other&nbsp;<em>and</em>&nbsp;they are in conflict with the status quo (see Section 2&nbsp;of the paper).</li> <li>At most one edit is accepted in&nbsp;each data point.</li> <li>In each legislature, each edit has a unique identifier.</li> </ul> <p>You&nbsp;can find the original documents where the amendments were proposed using the `source` key, which has the format `COMM-AM(YEAR)PENUMBER`.&nbsp;Use the following search tools for&nbsp;<a href="https://www.europarl.europa.eu/committees/en/archives/7/document-search">EP7</a>&nbsp;and&nbsp;<a href="https://www.europarl.europa.eu/committees/en/archives/8/document-search">EP8</a>&nbsp;(the PE number field should be enough, adding a &quot;.&quot; to fit the required format).</p> <p>The&nbsp;parliamentarians (MEPs, for Member of the European Parliament) have a unique identifier that you can use to get more details about them on the Parliament website: Go to&nbsp;<strong>https://www.europarl.europa.eu/meps/en/MEP_ID</strong>, where&nbsp;<strong>MEP_ID&nbsp;</strong>is the id of the MEP of interest.</p> <p><strong>Don&#39;t hesitate to&nbsp;<a href="mailto:victor.kristof@epfl.ch?subject=Question%20about%20the%20War%20of%20Words%20dataset">reach out to me</a>&nbsp;if you have any questions!</strong></p> <p>&nbsp;</p> <p>To cite this work:</p> <pre><code>@inproceedings{kristof2021war, author = {Kristof, Victor and Suresh, Aswin and Grossglauser, Matthias and Thiran, Patrick}, title = {War of Words II: Enriched Models for Law-Making Processes}, year = {2021}, booktitle = {Proceedings of The Web Conference 2021}, TODO: pages = {2803–2809}, numpages = {12}, location = {Ljubljana, Solvenia}, series = {WWW '21} }</code></pre> <p>&nbsp;</p></dct:description>
<dct:accessRights rdf:resource="http://publications.europa.eu/resource/authority/access-right/PUBLIC"/>
<dct:accessRights>
<dct:RightsStatement rdf:about="info:eu-repo/semantics/openAccess">
<rdfs:label>Open Access</rdfs:label>
</dct:RightsStatement>
</dct:accessRights>
<dcat:distribution>
<dcat:Distribution>
<dct:license rdf:resource="https://creativecommons.org/licenses/by/4.0/legalcode"/>
<dcat:accessURL rdf:resource="https://doi.org/10.5281/zenodo.4525015"/>
</dcat:Distribution>
</dcat:distribution>
<dcat:distribution>
<dcat:Distribution>
<dcat:accessURL rdf:resource="https://doi.org/10.5281/zenodo.4525015"/>
<dcat:byteSize>92272</dcat:byteSize>
<dcat:downloadURL rdf:resource="https://zenodo.org/record/4525015/files/helpers.zip"/>
<dcat:mediaType>application/zip</dcat:mediaType>
</dcat:Distribution>
</dcat:distribution>
<dcat:distribution>
<dcat:Distribution>
<dcat:accessURL rdf:resource="https://doi.org/10.5281/zenodo.4525015"/>
<dcat:byteSize>753438</dcat:byteSize>
<dcat:downloadURL rdf:resource="https://zenodo.org/record/4525015/files/split-indices.zip"/>
<dcat:mediaType>application/zip</dcat:mediaType>
</dcat:Distribution>
</dcat:distribution>
<dcat:distribution>
<dcat:Distribution>
<dcat:accessURL rdf:resource="https://doi.org/10.5281/zenodo.4525015"/>
<dcat:byteSize>43354347</dcat:byteSize>
<dcat:downloadURL rdf:resource="https://zenodo.org/record/4525015/files/text-embeddings.zip"/>
<dcat:mediaType>application/zip</dcat:mediaType>
</dcat:Distribution>
</dcat:distribution>
<dcat:distribution>
<dcat:Distribution>
<dcat:accessURL rdf:resource="https://doi.org/10.5281/zenodo.4525015"/>
<dcat:byteSize>448958857</dcat:byteSize>
<dcat:downloadURL rdf:resource="https://zenodo.org/record/4525015/files/war-of-words-2-ep7.txt"/>
<dcat:mediaType>text/plain</dcat:mediaType>
</dcat:Distribution>
</dcat:distribution>
<dcat:distribution>
<dcat:Distribution>
<dcat:accessURL rdf:resource="https://doi.org/10.5281/zenodo.4525015"/>
<dcat:byteSize>607401773</dcat:byteSize>
<dcat:downloadURL rdf:resource="https://zenodo.org/record/4525015/files/war-of-words-2-ep8.txt"/>
<dcat:mediaType>text/plain</dcat:mediaType>
</dcat:Distribution>
</dcat:distribution>
</rdf:Description>
</rdf:RDF>
147
59
views
downloads
| All versions | This version | |
|---|---|---|
| Views | 147 | 65 |
| Downloads | 59 | 21 |
| Data volume | 18.2 GB | 7.0 GB |
| Unique views | 112 | 56 |
| Unique downloads | 32 | 15 |
Indexed in
- Publication date:
- April 19, 2021
- DOI:
-
- Related identifiers:
- Continues
- 10.1145/3366423.3380041 (Dataset)
- Documented by
- 10.1145/3442381.3450131 (Conference paper)
- Communities:
- License (for files):
- Creative Commons Attribution 4.0 International