April 19, 2021 Dataset Open Access

Kristof, Victor; Suresh, Aswin; Grossglauser, Matthias; Thiran, Patrick

MARC21 XML Export

<?xml version='1.0' encoding='UTF-8'?>
<record xmlns="http://www.loc.gov/MARC21/slim">
  <leader>00000nmm##2200000uu#4500</leader>
  <controlfield tag="005">20210426153235.0</controlfield>
  <controlfield tag="001">4525015</controlfield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">EPFL</subfield>
    <subfield code="a">Suresh, Aswin</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">EPFL</subfield>
    <subfield code="a">Grossglauser, Matthias</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">EPFL</subfield>
    <subfield code="a">Thiran, Patrick</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">EPFL</subfield>
    <subfield code="4">prc</subfield>
    <subfield code="a">Kristof, Victor</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">EPFL</subfield>
    <subfield code="4">prc</subfield>
    <subfield code="a">Suresh, Aswin</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">92272</subfield>
    <subfield code="z">md5:152fdcf7c29a141e8b2febc3f6db437a</subfield>
    <subfield code="u">https://zenodo.org/record/4525015/files/helpers.zip</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">753438</subfield>
    <subfield code="z">md5:d7838210ab293c77d654d3c866e9e782</subfield>
    <subfield code="u">https://zenodo.org/record/4525015/files/split-indices.zip</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">43354347</subfield>
    <subfield code="z">md5:cf18ad0a99227af05f04ba6f3da2718c</subfield>
    <subfield code="u">https://zenodo.org/record/4525015/files/text-embeddings.zip</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">448958857</subfield>
    <subfield code="z">md5:2bcb1eb32600f292d6004720ab5971e7</subfield>
    <subfield code="u">https://zenodo.org/record/4525015/files/war-of-words-2-ep7.txt</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">607401773</subfield>
    <subfield code="z">md5:b607a18d0197fb76a985b3b96bf37fff</subfield>
    <subfield code="u">https://zenodo.org/record/4525015/files/war-of-words-2-ep8.txt</subfield>
  </datafield>
  <datafield tag="542" ind1=" " ind2=" ">
    <subfield code="l">open</subfield>
  </datafield>
  <datafield tag="260" ind1=" " ind2=" ">
    <subfield code="c">2021-04-19</subfield>
  </datafield>
  <datafield tag="909" ind1="C" ind2="O">
    <subfield code="p">openaire_data</subfield>
    <subfield code="p">user-epfl</subfield>
    <subfield code="o">oai:zenodo.org:4525015</subfield>
  </datafield>
  <datafield tag="100" ind1=" " ind2=" ">
    <subfield code="u">EPFL</subfield>
    <subfield code="a">Kristof, Victor</subfield>
  </datafield>
  <datafield tag="245" ind1=" " ind2=" ">
    <subfield code="a">War of Words II: Enriched Models of Law-Making Processes</subfield>
  </datafield>
  <datafield tag="980" ind1=" " ind2=" ">
    <subfield code="a">user-epfl</subfield>
  </datafield>
  <datafield tag="540" ind1=" " ind2=" ">
    <subfield code="u">https://creativecommons.org/licenses/by/4.0/legalcode</subfield>
    <subfield code="a">Creative Commons Attribution 4.0 International</subfield>
  </datafield>
  <datafield tag="650" ind1="1" ind2="7">
    <subfield code="a">cc-by</subfield>
    <subfield code="2">opendefinition.org</subfield>
  </datafield>
  <datafield tag="520" ind1=" " ind2=" ">
    <subfield code="a">&lt;pre&gt;&lt;code&gt;@inproceedings{kristof2021war,
  author = {Kristof, Victor and Suresh, Aswin and Grossglauser, Matthias and Thiran, Patrick},
  title = {War of Words II: Enriched Models for Law-Making Processes},
  year = {2021},
  booktitle = {Proceedings of The Web Conference 2021},
  TODO: pages = {2803–2809},
  numpages = {12},
  location = {Ljubljana, Solvenia},
  series = {WWW '21}
}&lt;/code&gt;&lt;/pre&gt;

&lt;p&gt;This upload contains the dataset presented and used in the paper:&lt;/p&gt;

&lt;blockquote&gt;
&lt;p&gt;Victor Kristof, Aswin Suresh, Matthias Grossglauser, Patrick Thiran, &lt;a href="https://infoscience.epfl.ch/record/284828"&gt;War of Words II: Enriched Models of Law-Making Processes&lt;/a&gt;,&amp;nbsp;The Web Conference 2021, April 19-23, 2021, Ljubljana, Slovenia&lt;/p&gt;
&lt;/blockquote&gt;

&lt;p&gt;The code to process and use the dataset can be found on&amp;nbsp;&lt;a href="https://github.com/indy-lab/war-of-words"&gt;GitHub&lt;/a&gt;.&lt;/p&gt;

&lt;p&gt;This is a follow-up work to&amp;nbsp;&lt;em&gt;&lt;a href="https://zenodo.org/record/3757714"&gt;War of Words: The Competitive Dynamics of Legislative Processes&lt;/a&gt;.&lt;/em&gt;&lt;/p&gt;

&lt;p&gt;The dataset is split into two legislature periods of the European Parliament, the 7th (&lt;strong&gt;war-of-words-2-ep7.txt&lt;/strong&gt;) and the 8th (&lt;strong&gt;war-of-words-2-ep8.txt&lt;/strong&gt;) legislature.&amp;nbsp;Here is a snippet to load the dataset (for EP8&amp;nbsp;in this example) in Python:&lt;/p&gt;

&lt;pre&gt;&lt;code class="language-python"&gt;import json

with open('path/to/war-of-words-2-ep8.txt') as f:
    dataset = [json.loads(l) for l in f.readlines()]
&lt;/code&gt;&lt;/pre&gt;

&lt;p&gt;In the two text files, each line is a data point representing a&amp;nbsp;&lt;em&gt;conflict between edits&lt;/em&gt;. It is encoded as a JSON list of dictionaries, where each dictionary is an edit.&amp;nbsp;Each edit has the following structure:&lt;/p&gt;

&lt;pre&gt;&lt;code class="language-json"&gt;{
  'edit_id': 163187,                     // Unique edit identifier
  'edit_type': 'insert',                 // One of 'insert', 'delete', or 'replace'
  'accepted': True,                      // Label
  'dossier_ref': 'ENVI-AD(2012)487738',  // Reference to dossier (see below)
  'dossier_type': 'opinion',             // One of 'opinion' or 'report'
  'date': '2017-03-02',                  // Date of vote of all amendments for this dossier
  'legal_act': 'regulation',             // One of 'regulation', 'directive', or 'decision'
  'committee': 'BUDG',                   // Committee in which this edit was proposed
  'outsider': False,                     // Whether the above committee is the reporting committee
  'article_type': 'recital',             // One of 7 article types
  'source': 'BUDG-AM(2017)599742',       // Reference to original document of the amendment
  'justification': None,                 // The text of the optional justification (or None)
  'edit_indices': {...},                 // Indices of edit in the amendment (see below)
  'text_original': [...],                // Original text reported in the source document (see below)
  'text_amended': [...],                 // Amended text reported in the source document (see below)
  'authors': [                           // List of authors
    {
      'id': 88882,                       // Unique MEP identifier (see below)
      'name': 'Victor NEGRESCU',         // MEP full name
      'gender': 'M',                     // Gender as reported on the Parliament database
      'nationality': 'Romania',          // One of 28 nationalities
      'group': 'Group of the Progressive Alliance of Socialists and Democrats in the European Parliament',                             // One 9 political groups
      'rapporteur': False                // Whether the MEP is rapporteur for this dossier
    },
  ],
}&lt;/code&gt;&lt;/pre&gt;

&lt;p&gt;The &lt;strong&gt;text_original&lt;/strong&gt;&amp;nbsp;and &lt;strong&gt;text_amended&lt;/strong&gt;&amp;nbsp;keys contain the portion of text reported in the `source` document. The text is tokenized as a list of terms (words, numbers, punctuation, ...).&amp;nbsp;&lt;em&gt;These two keys are not the actual edit.&lt;/em&gt;&amp;nbsp;This is because the amendments are reported as an edited paragraph (which also gives some context to the edit).&amp;nbsp;An amendment contains one or more edits. To access the actual text of the edit, use the&amp;nbsp;`edit_indices` key, which&amp;nbsp;is a dictionary (such as `{&amp;#39;i1&amp;#39;: 80, &amp;#39;i2&amp;#39;: 80, &amp;#39;j1&amp;#39;: 80, &amp;#39;j2&amp;#39;: 101}`). The `i1` and `i2` keys are the first and last indices of the change in the original text, and the `j1` and `j2` keys are the first and last indices of the amended text. Hence, you can access the text of the edit by doing:&lt;/p&gt;

&lt;pre&gt;&lt;code class="language-python"&gt;idx = edit['edit_indices']
i1, i2, j1, j2 = idx['i1'], idx['i2'], idx['j1'], idx['j2']
old = edit['text_original'][i1:i2]
new = edit['text_amended'][j1:j2]

print(f'"{old}" is replaced by "{new}"')&lt;/code&gt;&lt;/pre&gt;

&lt;p&gt;If an edit is an insertion, then `i1 == i2`. If it is a deletion, then `j1 == j2`. Read the documentation of &lt;a href="https://docs.python.org/3.6/library/difflib.html#difflib.SequenceMatcher.get_opcodes"&gt;difflib&lt;/a&gt; to learn more about how these indices&amp;nbsp;are obtained.&lt;/p&gt;

&lt;p&gt;You can assume that:&lt;/p&gt;

&lt;ul&gt;
	&lt;li&gt;Each data point has at least one edit.&lt;/li&gt;
	&lt;li&gt;If there is only one edit, then it is&amp;nbsp;&lt;em&gt;in conflict with the status quo&amp;nbsp;&lt;/em&gt;(see Section 2&amp;nbsp;of the paper).&lt;/li&gt;
	&lt;li&gt;If there are two or more edits in conflict, then they are all in conflict against each other&amp;nbsp;&lt;em&gt;and&lt;/em&gt;&amp;nbsp;they are in conflict with the status quo (see Section 2&amp;nbsp;of the paper).&lt;/li&gt;
	&lt;li&gt;At most one edit is accepted in&amp;nbsp;each data point.&lt;/li&gt;
	&lt;li&gt;In each legislature, each edit has a unique identifier.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;You&amp;nbsp;can find the original documents where the amendments were proposed using the `source` key, which has the format `COMM-AM(YEAR)PENUMBER`.&amp;nbsp;Use the following search tools for&amp;nbsp;&lt;a href="https://www.europarl.europa.eu/committees/en/archives/7/document-search"&gt;EP7&lt;/a&gt;&amp;nbsp;and&amp;nbsp;&lt;a href="https://www.europarl.europa.eu/committees/en/archives/8/document-search"&gt;EP8&lt;/a&gt;&amp;nbsp;(the PE number field should be enough, adding a &amp;quot;.&amp;quot; to fit the required format).&lt;/p&gt;

&lt;p&gt;The&amp;nbsp;parliamentarians (MEPs, for Member of the European Parliament) have a unique identifier that you can use to get more details about them on the Parliament website: Go to&amp;nbsp;&lt;strong&gt;https://www.europarl.europa.eu/meps/en/MEP_ID&lt;/strong&gt;, where&amp;nbsp;&lt;strong&gt;MEP_ID&amp;nbsp;&lt;/strong&gt;is the id of the MEP of interest.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Don&amp;#39;t hesitate to&amp;nbsp;&lt;a href="mailto:victor.kristof@epfl.ch?subject=Question%20about%20the%20War%20of%20Words%20dataset"&gt;reach out to me&lt;/a&gt;&amp;nbsp;if you have any questions!&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;&amp;nbsp;&lt;/p&gt;

&lt;p&gt;To cite this work:&lt;/p&gt;

&lt;pre&gt;&lt;code&gt;@inproceedings{kristof2021war,
  author = {Kristof, Victor and Suresh, Aswin and Grossglauser, Matthias and Thiran, Patrick},
  title = {War of Words II: Enriched Models for Law-Making Processes},
  year = {2021},
  booktitle = {Proceedings of The Web Conference 2021},
  TODO: pages = {2803–2809},
  numpages = {12},
  location = {Ljubljana, Solvenia},
  series = {WWW '21}
}&lt;/code&gt;&lt;/pre&gt;

&lt;p&gt;&amp;nbsp;&lt;/p&gt;</subfield>
  </datafield>
  <datafield tag="773" ind1=" " ind2=" ">
    <subfield code="n">doi</subfield>
    <subfield code="i">isDocumentedBy</subfield>
    <subfield code="a">10.1145/3442381.3450131</subfield>
  </datafield>
  <datafield tag="773" ind1=" " ind2=" ">
    <subfield code="n">doi</subfield>
    <subfield code="i">continues</subfield>
    <subfield code="a">10.1145/3366423.3380041</subfield>
  </datafield>
  <datafield tag="773" ind1=" " ind2=" ">
    <subfield code="n">doi</subfield>
    <subfield code="i">isVersionOf</subfield>
    <subfield code="a">10.5281/zenodo.4525014</subfield>
  </datafield>
  <datafield tag="024" ind1=" " ind2=" ">
    <subfield code="a">10.5281/zenodo.4525015</subfield>
    <subfield code="2">doi</subfield>
  </datafield>
  <datafield tag="980" ind1=" " ind2=" ">
    <subfield code="a">dataset</subfield>
  </datafield>
</record>