April 19, 2021 Dataset Open Access

Kristof, Victor; Suresh, Aswin; Grossglauser, Matthias; Thiran, Patrick

DataCite XML Export

<?xml version='1.0' encoding='utf-8'?>
<resource xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="http://datacite.org/schema/kernel-4" xsi:schemaLocation="http://datacite.org/schema/kernel-4 http://schema.datacite.org/meta/kernel-4.1/metadata.xsd">
  <identifier identifierType="DOI">10.5281/zenodo.4525015</identifier>
  <creators>
    <creator>
      <creatorName>Kristof, Victor</creatorName>
      <givenName>Victor</givenName>
      <familyName>Kristof</familyName>
      <affiliation>EPFL</affiliation>
    </creator>
    <creator>
      <creatorName>Suresh, Aswin</creatorName>
      <givenName>Aswin</givenName>
      <familyName>Suresh</familyName>
      <affiliation>EPFL</affiliation>
    </creator>
    <creator>
      <creatorName>Grossglauser, Matthias</creatorName>
      <givenName>Matthias</givenName>
      <familyName>Grossglauser</familyName>
      <affiliation>EPFL</affiliation>
    </creator>
    <creator>
      <creatorName>Thiran, Patrick</creatorName>
      <givenName>Patrick</givenName>
      <familyName>Thiran</familyName>
      <affiliation>EPFL</affiliation>
    </creator>
  </creators>
  <titles>
    <title>War of Words II: Enriched Models of Law-Making Processes</title>
  </titles>
  <publisher>Zenodo</publisher>
  <publicationYear>2021</publicationYear>
  <contributors>
    <contributor contributorType="ContactPerson">
      <contributorName>Kristof, Victor</contributorName>
      <givenName>Victor</givenName>
      <familyName>Kristof</familyName>
      <affiliation>EPFL</affiliation>
    </contributor>
    <contributor contributorType="ContactPerson">
      <contributorName>Suresh, Aswin</contributorName>
      <givenName>Aswin</givenName>
      <familyName>Suresh</familyName>
      <affiliation>EPFL</affiliation>
    </contributor>
  </contributors>
  <dates>
    <date dateType="Issued">2021-04-19</date>
  </dates>
  <resourceType resourceTypeGeneral="Dataset"/>
  <alternateIdentifiers>
    <alternateIdentifier alternateIdentifierType="url">https://zenodo.org/record/4525015</alternateIdentifier>
  </alternateIdentifiers>
  <relatedIdentifiers>
    <relatedIdentifier relatedIdentifierType="DOI" relationType="IsDocumentedBy" resourceTypeGeneral="ConferencePaper">10.1145/3442381.3450131</relatedIdentifier>
    <relatedIdentifier relatedIdentifierType="DOI" relationType="Continues" resourceTypeGeneral="Dataset">10.1145/3366423.3380041</relatedIdentifier>
    <relatedIdentifier relatedIdentifierType="DOI" relationType="IsVersionOf">10.5281/zenodo.4525014</relatedIdentifier>
    <relatedIdentifier relatedIdentifierType="URL" relationType="IsPartOf">https://zenodo.org/communities/epfl</relatedIdentifier>
  </relatedIdentifiers>
  <version>1.0</version>
  <rightsList>
    <rights rightsURI="https://creativecommons.org/licenses/by/4.0/legalcode">Creative Commons Attribution 4.0 International</rights>
    <rights rightsURI="info:eu-repo/semantics/openAccess">Open Access</rights>
  </rightsList>
  <descriptions>
    <description descriptionType="Abstract">&lt;pre&gt;&lt;code&gt;@inproceedings{kristof2021war,
  author = {Kristof, Victor and Suresh, Aswin and Grossglauser, Matthias and Thiran, Patrick},
  title = {War of Words II: Enriched Models for Law-Making Processes},
  year = {2021},
  booktitle = {Proceedings of The Web Conference 2021},
  TODO: pages = {2803–2809},
  numpages = {12},
  location = {Ljubljana, Solvenia},
  series = {WWW '21}
}&lt;/code&gt;&lt;/pre&gt;

&lt;p&gt;This upload contains the dataset presented and used in the paper:&lt;/p&gt;

&lt;blockquote&gt;
&lt;p&gt;Victor Kristof, Aswin Suresh, Matthias Grossglauser, Patrick Thiran, &lt;a href="https://infoscience.epfl.ch/record/284828"&gt;War of Words II: Enriched Models of Law-Making Processes&lt;/a&gt;,&amp;nbsp;The Web Conference 2021, April 19-23, 2021, Ljubljana, Slovenia&lt;/p&gt;
&lt;/blockquote&gt;

&lt;p&gt;The code to process and use the dataset can be found on&amp;nbsp;&lt;a href="https://github.com/indy-lab/war-of-words"&gt;GitHub&lt;/a&gt;.&lt;/p&gt;

&lt;p&gt;This is a follow-up work to&amp;nbsp;&lt;em&gt;&lt;a href="https://zenodo.org/record/3757714"&gt;War of Words: The Competitive Dynamics of Legislative Processes&lt;/a&gt;.&lt;/em&gt;&lt;/p&gt;

&lt;p&gt;The dataset is split into two legislature periods of the European Parliament, the 7th (&lt;strong&gt;war-of-words-2-ep7.txt&lt;/strong&gt;) and the 8th (&lt;strong&gt;war-of-words-2-ep8.txt&lt;/strong&gt;) legislature.&amp;nbsp;Here is a snippet to load the dataset (for EP8&amp;nbsp;in this example) in Python:&lt;/p&gt;

&lt;pre&gt;&lt;code class="language-python"&gt;import json

with open('path/to/war-of-words-2-ep8.txt') as f:
    dataset = [json.loads(l) for l in f.readlines()]
&lt;/code&gt;&lt;/pre&gt;

&lt;p&gt;In the two text files, each line is a data point representing a&amp;nbsp;&lt;em&gt;conflict between edits&lt;/em&gt;. It is encoded as a JSON list of dictionaries, where each dictionary is an edit.&amp;nbsp;Each edit has the following structure:&lt;/p&gt;

&lt;pre&gt;&lt;code class="language-json"&gt;{
  'edit_id': 163187,                     // Unique edit identifier
  'edit_type': 'insert',                 // One of 'insert', 'delete', or 'replace'
  'accepted': True,                      // Label
  'dossier_ref': 'ENVI-AD(2012)487738',  // Reference to dossier (see below)
  'dossier_type': 'opinion',             // One of 'opinion' or 'report'
  'date': '2017-03-02',                  // Date of vote of all amendments for this dossier
  'legal_act': 'regulation',             // One of 'regulation', 'directive', or 'decision'
  'committee': 'BUDG',                   // Committee in which this edit was proposed
  'outsider': False,                     // Whether the above committee is the reporting committee
  'article_type': 'recital',             // One of 7 article types
  'source': 'BUDG-AM(2017)599742',       // Reference to original document of the amendment
  'justification': None,                 // The text of the optional justification (or None)
  'edit_indices': {...},                 // Indices of edit in the amendment (see below)
  'text_original': [...],                // Original text reported in the source document (see below)
  'text_amended': [...],                 // Amended text reported in the source document (see below)
  'authors': [                           // List of authors
    {
      'id': 88882,                       // Unique MEP identifier (see below)
      'name': 'Victor NEGRESCU',         // MEP full name
      'gender': 'M',                     // Gender as reported on the Parliament database
      'nationality': 'Romania',          // One of 28 nationalities
      'group': 'Group of the Progressive Alliance of Socialists and Democrats in the European Parliament',                             // One 9 political groups
      'rapporteur': False                // Whether the MEP is rapporteur for this dossier
    },
  ],
}&lt;/code&gt;&lt;/pre&gt;

&lt;p&gt;The &lt;strong&gt;text_original&lt;/strong&gt;&amp;nbsp;and &lt;strong&gt;text_amended&lt;/strong&gt;&amp;nbsp;keys contain the portion of text reported in the `source` document. The text is tokenized as a list of terms (words, numbers, punctuation, ...).&amp;nbsp;&lt;em&gt;These two keys are not the actual edit.&lt;/em&gt;&amp;nbsp;This is because the amendments are reported as an edited paragraph (which also gives some context to the edit).&amp;nbsp;An amendment contains one or more edits. To access the actual text of the edit, use the&amp;nbsp;`edit_indices` key, which&amp;nbsp;is a dictionary (such as `{&amp;#39;i1&amp;#39;: 80, &amp;#39;i2&amp;#39;: 80, &amp;#39;j1&amp;#39;: 80, &amp;#39;j2&amp;#39;: 101}`). The `i1` and `i2` keys are the first and last indices of the change in the original text, and the `j1` and `j2` keys are the first and last indices of the amended text. Hence, you can access the text of the edit by doing:&lt;/p&gt;

&lt;pre&gt;&lt;code class="language-python"&gt;idx = edit['edit_indices']
i1, i2, j1, j2 = idx['i1'], idx['i2'], idx['j1'], idx['j2']
old = edit['text_original'][i1:i2]
new = edit['text_amended'][j1:j2]

print(f'"{old}" is replaced by "{new}"')&lt;/code&gt;&lt;/pre&gt;

&lt;p&gt;If an edit is an insertion, then `i1 == i2`. If it is a deletion, then `j1 == j2`. Read the documentation of &lt;a href="https://docs.python.org/3.6/library/difflib.html#difflib.SequenceMatcher.get_opcodes"&gt;difflib&lt;/a&gt; to learn more about how these indices&amp;nbsp;are obtained.&lt;/p&gt;

&lt;p&gt;You can assume that:&lt;/p&gt;

&lt;ul&gt;
	&lt;li&gt;Each data point has at least one edit.&lt;/li&gt;
	&lt;li&gt;If there is only one edit, then it is&amp;nbsp;&lt;em&gt;in conflict with the status quo&amp;nbsp;&lt;/em&gt;(see Section 2&amp;nbsp;of the paper).&lt;/li&gt;
	&lt;li&gt;If there are two or more edits in conflict, then they are all in conflict against each other&amp;nbsp;&lt;em&gt;and&lt;/em&gt;&amp;nbsp;they are in conflict with the status quo (see Section 2&amp;nbsp;of the paper).&lt;/li&gt;
	&lt;li&gt;At most one edit is accepted in&amp;nbsp;each data point.&lt;/li&gt;
	&lt;li&gt;In each legislature, each edit has a unique identifier.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;You&amp;nbsp;can find the original documents where the amendments were proposed using the `source` key, which has the format `COMM-AM(YEAR)PENUMBER`.&amp;nbsp;Use the following search tools for&amp;nbsp;&lt;a href="https://www.europarl.europa.eu/committees/en/archives/7/document-search"&gt;EP7&lt;/a&gt;&amp;nbsp;and&amp;nbsp;&lt;a href="https://www.europarl.europa.eu/committees/en/archives/8/document-search"&gt;EP8&lt;/a&gt;&amp;nbsp;(the PE number field should be enough, adding a &amp;quot;.&amp;quot; to fit the required format).&lt;/p&gt;

&lt;p&gt;The&amp;nbsp;parliamentarians (MEPs, for Member of the European Parliament) have a unique identifier that you can use to get more details about them on the Parliament website: Go to&amp;nbsp;&lt;strong&gt;https://www.europarl.europa.eu/meps/en/MEP_ID&lt;/strong&gt;, where&amp;nbsp;&lt;strong&gt;MEP_ID&amp;nbsp;&lt;/strong&gt;is the id of the MEP of interest.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Don&amp;#39;t hesitate to&amp;nbsp;&lt;a href="mailto:victor.kristof@epfl.ch?subject=Question%20about%20the%20War%20of%20Words%20dataset"&gt;reach out to me&lt;/a&gt;&amp;nbsp;if you have any questions!&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;&amp;nbsp;&lt;/p&gt;

&lt;p&gt;To cite this work:&lt;/p&gt;

&lt;pre&gt;&lt;code&gt;@inproceedings{kristof2021war,
  author = {Kristof, Victor and Suresh, Aswin and Grossglauser, Matthias and Thiran, Patrick},
  title = {War of Words II: Enriched Models for Law-Making Processes},
  year = {2021},
  booktitle = {Proceedings of The Web Conference 2021},
  TODO: pages = {2803–2809},
  numpages = {12},
  location = {Ljubljana, Solvenia},
  series = {WWW '21}
}&lt;/code&gt;&lt;/pre&gt;

&lt;p&gt;&amp;nbsp;&lt;/p&gt;</description>
  </descriptions>
</resource>