Software Open Access

The D-NET software toolkit: dnet-basic-aggregator

Michele Artini; Claudio Atzori; Alessia Bardi; Sandro La Bruzzo; Paolo Manghi; Andrea Mannocci


JSON Export

{
  "files": [
    {
      "links": {
        "self": "https://zenodo.org/api/files/dddeed9f-e23c-4559-83a7-8c3b92d2604b/dnet-team/dnet-basic-aggregator-1.3.0.zip"
      }, 
      "checksum": "md5:119ee0ff5f82d26be1987fc607d3df38", 
      "bucket": "dddeed9f-e23c-4559-83a7-8c3b92d2604b", 
      "key": "dnet-team/dnet-basic-aggregator-1.3.0.zip", 
      "type": "zip", 
      "size": 392890
    }
  ], 
  "owners": [
    18612
  ], 
  "doi": "10.5281/zenodo.168362", 
  "stats": {
    "version_unique_downloads": 66.0, 
    "unique_views": 133.0, 
    "views": 151.0, 
    "version_views": 818.0, 
    "unique_downloads": 16.0, 
    "version_unique_views": 690.0, 
    "volume": 7464910.0, 
    "version_downloads": 80.0, 
    "downloads": 19.0, 
    "version_volume": 474038692.0
  }, 
  "links": {
    "doi": "https://doi.org/10.5281/zenodo.168362", 
    "conceptdoi": "https://doi.org/10.5281/zenodo.594239", 
    "bucket": "https://zenodo.org/api/files/dddeed9f-e23c-4559-83a7-8c3b92d2604b", 
    "conceptbadge": "https://zenodo.org/badge/doi/10.5281/zenodo.594239.svg", 
    "html": "https://zenodo.org/record/168362", 
    "latest_html": "https://zenodo.org/record/168362", 
    "badge": "https://zenodo.org/badge/doi/10.5281/zenodo.168362.svg", 
    "latest": "https://zenodo.org/api/records/168362"
  }, 
  "conceptdoi": "10.5281/zenodo.594239", 
  "created": "2016-11-24T10:45:55.574734+00:00", 
  "updated": "2020-12-02T17:16:59.660657+00:00", 
  "conceptrecid": "594239", 
  "revision": 13, 
  "id": 168362, 
  "metadata": {
    "access_right_category": "success", 
    "doi": "10.5281/zenodo.168362", 
    "version": "1.3.0", 
    "license": {
      "id": "AGPL-3.0-or-later"
    }, 
    "title": "The D-NET software toolkit: dnet-basic-aggregator", 
    "related_identifiers": [
      {
        "scheme": "url", 
        "identifier": "https://github.com/dnet-team/dnet-basic-aggregator/tree/1.3.0", 
        "relation": "isDocumentedBy", 
        "resource_type": "software"
      }, 
      {
        "scheme": "url", 
        "identifier": "http://svn-public.driver.research-infrastructures.eu/driver/dnet45/modules", 
        "relation": "isCompiledBy", 
        "resource_type": "software"
      }, 
      {
        "scheme": "doi", 
        "identifier": "10.1108/PROG-08-2013-0045", 
        "relation": "references", 
        "resource_type": "publication-article"
      }, 
      {
        "scheme": "doi", 
        "identifier": "10.5281/zenodo.594239", 
        "relation": "isVersionOf"
      }
    ], 
    "relations": {
      "version": [
        {
          "count": 5, 
          "index": 4, 
          "parent": {
            "pid_type": "recid", 
            "pid_value": "594239"
          }, 
          "is_last": true, 
          "last_child": {
            "pid_type": "recid", 
            "pid_value": "168362"
          }
        }
      ]
    }, 
    "grants": [
      {
        "code": "777541", 
        "links": {
          "self": "https://zenodo.org/api/grants/10.13039/501100000780::777541"
        }, 
        "title": "OpenAIRE Advancing Open Scholarship", 
        "acronym": "OpenAIRE-Advance", 
        "program": "H2020", 
        "funder": {
          "doi": "10.13039/501100000780", 
          "acronyms": [], 
          "name": "European Commission", 
          "links": {
            "self": "https://zenodo.org/api/funders/10.13039/501100000780"
          }
        }
      }, 
      {
        "code": "246686", 
        "links": {
          "self": "https://zenodo.org/api/grants/10.13039/501100000780::246686"
        }, 
        "title": "Open Access Infrastructure for Research in Europe", 
        "acronym": "OPENAIRE", 
        "program": "FP7", 
        "funder": {
          "doi": "10.13039/501100000780", 
          "acronyms": [], 
          "name": "European Commission", 
          "links": {
            "self": "https://zenodo.org/api/funders/10.13039/501100000780"
          }
        }
      }, 
      {
        "code": "731011", 
        "links": {
          "self": "https://zenodo.org/api/grants/10.13039/501100000780::731011"
        }, 
        "title": "OpenAIRE - CONNECTing scientific results in support of Open Science", 
        "acronym": "OpenAIRE-Connect", 
        "program": "H2020", 
        "funder": {
          "doi": "10.13039/501100000780", 
          "acronyms": [], 
          "name": "European Commission", 
          "links": {
            "self": "https://zenodo.org/api/funders/10.13039/501100000780"
          }
        }
      }, 
      {
        "code": "654119", 
        "links": {
          "self": "https://zenodo.org/api/grants/10.13039/501100000780::654119"
        }, 
        "title": "Pooling Activities, Resources and Tools for Heritage E-research Networking, Optimization and Synergies", 
        "acronym": "PARTHENOS", 
        "program": "H2020", 
        "funder": {
          "doi": "10.13039/501100000780", 
          "acronyms": [], 
          "name": "European Commission", 
          "links": {
            "self": "https://zenodo.org/api/funders/10.13039/501100000780"
          }
        }
      }, 
      {
        "code": "643410", 
        "links": {
          "self": "https://zenodo.org/api/grants/10.13039/501100000780::643410"
        }, 
        "title": "Open Access Infrastructure for Research in Europe 2020", 
        "acronym": "OpenAIRE2020", 
        "program": "H2020", 
        "funder": {
          "doi": "10.13039/501100000780", 
          "acronyms": [], 
          "name": "European Commission", 
          "links": {
            "self": "https://zenodo.org/api/funders/10.13039/501100000780"
          }
        }
      }, 
      {
        "code": "283595", 
        "links": {
          "self": "https://zenodo.org/api/grants/10.13039/501100000780::283595"
        }, 
        "title": "2nd-Generation Open Access Infrastructure for Research in Europe", 
        "acronym": "OPENAIREPLUS", 
        "program": "FP7", 
        "funder": {
          "doi": "10.13039/501100000780", 
          "acronyms": [], 
          "name": "European Commission", 
          "links": {
            "self": "https://zenodo.org/api/funders/10.13039/501100000780"
          }
        }
      }, 
      {
        "code": "313193", 
        "links": {
          "self": "https://zenodo.org/api/grants/10.13039/501100000780::313193"
        }, 
        "title": "Advanced Research Infrastructure for Archaeological Dataset Networking in Europe", 
        "acronym": "ARIADNE", 
        "program": "FP7", 
        "funder": {
          "doi": "10.13039/501100000780", 
          "acronyms": [], 
          "name": "European Commission", 
          "links": {
            "self": "https://zenodo.org/api/funders/10.13039/501100000780"
          }
        }
      }
    ], 
    "keywords": [
      "aggregator", 
      "soa", 
      "soap", 
      "oai_pmh", 
      "oai", 
      "dnet", 
      "metadata", 
      "distributed systems", 
      "digital library"
    ], 
    "publication_date": "2016-11-24", 
    "creators": [
      {
        "orcid": "0000-0002-4406-428X", 
        "affiliation": "ISTI-CNR", 
        "name": "Michele Artini"
      }, 
      {
        "orcid": "0000-0001-9613-6639", 
        "affiliation": "ISTI-CNR", 
        "name": "Claudio Atzori"
      }, 
      {
        "orcid": "0000-0002-1112-1292", 
        "affiliation": "ISTI-CNR", 
        "name": "Alessia Bardi"
      }, 
      {
        "orcid": "0000-0003-2855-1245", 
        "affiliation": "ISTI-CNR", 
        "name": "Sandro La Bruzzo"
      }, 
      {
        "orcid": "0000-0001-7291-3210", 
        "affiliation": "ISTI-CNR", 
        "name": "Paolo Manghi"
      }, 
      {
        "orcid": "0000-0002-5193-7851", 
        "affiliation": "ISTI-CNR", 
        "name": "Andrea Mannocci"
      }
    ], 
    "access_right": "open", 
    "resource_type": {
      "type": "software", 
      "title": "Software"
    }, 
    "description": "<p>D-Net Software Toolikt</p>\n\n<p>The D-NET Software Toolkit is a system that offers functionalities for the collection (&ldquo;harvesting&rdquo;), transformation, aggregation, and indexing of metadata records collected from an arbitrary number of data sources, complying with different protocols and data exchange formats. D-NET sets a workflow language, which developers can use to combine a variety of D-NET data management services, configure them to handle data according to given data models, and pipeline them into autonomic data processing workflows.</p>\n\n<p>This software package is a simplified version of the D-Net toolkit and consists of a web application with a minimal set of services for:</p>\n\n<ul>\n\t<li>\n\t<p>Collection of metadata records in oai_dc format via OAI-PMH, FTP, local file system, HTTP.</p>\n\t</li>\n\t<li>\n\t<p>Transformation of the collected metadata records into an internal format named DMF (Driver Metadata Format)</p>\n\t</li>\n\t<li>\n\t<p>Indexing of DMF records in a Solr full-text index</p>\n\t</li>\n\t<li>\n\t<p>OAI-PMH export of aggregated metadata records in DMF and oai_dc formats. More formats can be added at runtime by providing a dedicated XSLT from DMF to the desired target format.</p>\n\t</li>\n</ul>\n\n<p>Major changes in version&nbsp;1.3.0</p>\n\n<ul>\n\t<li>OAI Publisher:\n\t<ul>\n\t\t<li>fixed cache management</li>\n\t\t<li>fixed oai consistency (post feed) workflow branch</li>\n\t\t<li>fixed deletion of content when workflow of data sources are deleted</li>\n\t</ul>\n\t</li>\n\t<li>D-Net enabling services:\n\t<ul>\n\t\t<li>using cache for subscription access</li>\n\t\t<li>support only one subscription registry</li>\n\t</ul>\n\t</li>\n\t<li>Mongo based services (mdstore, oaistore, wf logging):\n\t<ul>\n\t\t<li>using API of mongo-java-driver 3.2.2, removed usage of deprecated methods</li>\n\t\t<li>tracking the number of stored records to possibly highlight the collection of records with the same identifier</li>\n\t</ul>\n\t</li>\n\t<li>GUI:\n\t<ul>\n\t\t<li>enabling deletion of APIs via GUI</li>\n\t\t<li>enabling editing of metadata_identifier_path</li>\n\t\t<li>more info available in the datasource section</li>\n\t\t<li>removed map of data sources (TODO: adapt to the new google map API)</li>\n\t</ul>\n\t</li>\n\t<li>Metadata collection:\n\t<ul>\n\t\t<li>handling HTML illegal entities in collected XMLs</li>\n\t</ul>\n\t</li>\n\t<li>Indexing:\n\t<ul>\n\t\t<li>default query operator for &quot;bag of words&quot; queries set to AND instead of OR</li>\n\t</ul>\n\t</li>\n\t<li>Workflow manager\n\t<ul>\n\t\t<li>do not launch workflows that were scheduled for execution during a pause of the aggregation system (&quot;prepare for shutdown&quot;)</li>\n\t</ul>\n\t</li>\n</ul>\n\n<p>Official Web Site: http://www.d-net.research-infrastructures.eu</p>\n\n<p>Need support? Contact us via email on&nbsp;dnet-team[at]isti.cnr.it</p>"
  }
}
818
80
views
downloads
All versions This version
Views 818151
Downloads 8019
Data volume 474.0 MB7.5 MB
Unique views 690133
Unique downloads 6616

Share

Cite as