Report Open Access

Automating WLCG Job Accounting Validation

Christidis, Dimitrios; Andreeva, Julia

MARC21 XML Export

<?xml version='1.0' encoding='UTF-8'?>
<record xmlns="">
  <datafield tag="653" ind1=" " ind2=" ">
    <subfield code="a">CERN openlab summer student</subfield>
  <controlfield tag="005">20170908080241.0</controlfield>
  <controlfield tag="001">206942</controlfield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Summer Student Supervisor</subfield>
    <subfield code="a">Andreeva, Julia</subfield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">1168062</subfield>
    <subfield code="z">md5:079f7008649acef7465d912506c8c68e</subfield>
    <subfield code="u"> WLCG Job Accounting Validation.pdf</subfield>
  <datafield tag="542" ind1=" " ind2=" ">
    <subfield code="l">open</subfield>
  <datafield tag="260" ind1=" " ind2=" ">
    <subfield code="c">2016-12-16</subfield>
  <datafield tag="909" ind1="C" ind2="O">
    <subfield code="p">openaire</subfield>
    <subfield code="p">user-cernopenlab</subfield>
    <subfield code="o"></subfield>
  <datafield tag="100" ind1=" " ind2=" ">
    <subfield code="u">CERN openlab Summer Student</subfield>
    <subfield code="a">Christidis, Dimitrios</subfield>
  <datafield tag="245" ind1=" " ind2=" ">
    <subfield code="a">Automating WLCG Job Accounting Validation</subfield>
  <datafield tag="980" ind1=" " ind2=" ">
    <subfield code="a">user-cernopenlab</subfield>
  <datafield tag="540" ind1=" " ind2=" ">
    <subfield code="u"></subfield>
    <subfield code="a">Creative Commons Attribution 4.0 International</subfield>
  <datafield tag="650" ind1="1" ind2="7">
    <subfield code="a">cc-by</subfield>
    <subfield code="2"></subfield>
  <datafield tag="520" ind1=" " ind2=" ">
    <subfield code="a">&lt;p&gt;Project Specification&lt;/p&gt;

&lt;p&gt;The WLCG infrastructure provides resources to store, distribute and analyse the data generated by the Large Hadron Collider (LHC). The LHC data is analysed at multiple computing facilities at the geographically dispersed LHC Grid sites. Accounting data are produced for each job executed on the Grid and collected to a central accounting repository through APEL. One of the goals of the WLCG accounting project is to prove the trustworthiness of the data presented on the new accounting portal. This entails performing automated, frequent comparisons against the data from the experiment-specific accounting systems and visualising the results. The student will work on an existing implementation with the goal of completing the necessary features, providing improvements and creating an infrastructure for its automated execution.&lt;/p&gt;


&lt;p&gt;The WLCG Accounting Task Force is overseeing the creation of a new accounting portal. One of the areas of work is to check the trustworthiness of the provided data. This is accomplished by making comparisons against the data from the accounting systems used by the LHC experiments. To that end, a script was created to perform these checks and publish the results online. Addition-al emphasis was given on making sure it is fully automated and on improving the visualisation of the results. The initial outcome has been positive and some accounting issues were discovered and fixed.&lt;/p&gt;</subfield>
  <datafield tag="024" ind1=" " ind2=" ">
    <subfield code="a">10.5281/zenodo.206942</subfield>
    <subfield code="2">doi</subfield>
  <datafield tag="980" ind1=" " ind2=" ">
    <subfield code="a">publication</subfield>
    <subfield code="b">report</subfield>
All versions This version
Views 7373
Downloads 2020
Data volume 23.4 MB23.4 MB
Unique views 6464
Unique downloads 2020


Cite as