There is a newer version of the record available.

Published November 7, 2019 | Version v2.0.0
Software Open

FilteredPush/event_date_qc: Release version 2.0.0 of the event_date_qc library, updated FFDQ support.

  • 1. Museum of Comparative Zoology, Harvard University

Description

Release version 2.0.0 of the FilteredPush event_date_qc library for testing data quality of date data. This library provides low level tests of date data and higher level tests for DarwinCore Event terms with those tests described with RDF metadata following the standard biodiversity data quality test descriptions by the TDWG Biodiversity Data Quality Interest Group Task Group 2 on tests and assertions.

This release incorporates changes to the API to support FFDQ, and updates some tests to current TG2 test definitions. Notes on changes in this release: Creating a clean no-snapshots referenced release. Updating pom to reference 2.0.0 ffdq-api instead of snapshot, incrementing version to 2.0.0, updating README. Correcting Javadoc build error. ISSUE: #8 tdwg/bdq#125 Updating VALIDATION_DAY_OUTOFRANGE in line with proposal for internal prerequisites not met in issue, applying correct guid to issue, updating handling of internal prerequisites not met. ISSUE: #8 tdwg/bdq#147 Updating VALIDATION_DAY_NOTSTANDARD. VALIDATION_DAY_NOTSTANDARD now returns NOT_COMPLIANT for any dwc:day value except an integer in the range 1-31, prerequisites not met no longer thrown internally to this implementation as that is only returned if term is absent. Adding command line options to parse dates from standard input and from a command line argument. Adding to DateUtils main method -i to read a line from standard input and -v date to read a date as a command line argument. Preventing null pointer exception on problem case in date parsing. Reducing logging messages. Reducing logging level for joda exception related to out of range token values in date parsing. Correcting version of ffdq-api to 2.0.0-SNAPSHOT to fit with standard semantic versioning scheme used in kurator. Fixes to example data to allow publishing in IPT. Fixed two duplicate occurrenceId values. Updated date modified for new records. Adding command line use documentation. Improving use on the command line. Adding slightly better error condition handling to DateUtils.main(), adding a log4j2 configuration file to suppress warning message from log4j. Added description of command line options. Allowing run on a list of dates from the jar. Adding main class to the shaded jar manifest in the pom. Adding example data (modified from real data) to provide at least one case for each of the current BDQ TG2 Event related tests. Added a column concatenating all of the resource relationship terms for provision in a remark term when resource relationship terms aren't available (e.g. for mapping into IPT). Updated version to 2.0.0 to reflect the changes to the ffdq API Consistent with the current versions of kurator-ffdq and ffdq-api Merging from the ffdq branch to support 2.0-SNAPSHOT API Version Changes from branch include new set of return types used in the RDF representation of the framework. Updates to the DQ classes and CSV to work with ffdq test runner. Adding csv file generated from tdwg/bdq test issues with label=Time on Feb 8. Updating dq class with changes to amendment values in kurator-ffdq. The underlying object as part of AmendmentValue is now a java Map. Minor fix to missing result values when result state is CHANGED. Reformatting the csv file to match the spreadsheet of standardized tests. Same format however contains only the event_date_qc tests. Added an xlsx version that contains rows taken from spreadsheet. The full row data from the spreadsheet of standardized tests for tests defined in the DwCEventDQ.csv. Still need to add the missing tests. Adding the IDs from the spreadsheet of standardized tests. Minor fix, no change in the extractDateFromVerbatim has empty result. In the report, no change should have no value for the result. Was an empty data resource instead. Minor fix, adding comment to extract date from start/end date test. Using maven to include dependencies in jar for use with test runner . The ffdq test runner will run tests from a class on the classpath. Packaging dependencies in the jar will enable test runner to run tests from the event_date_qc-1.0.4-SNAPSHOT.jar. Minor fix, eventDateConsistentWithVerbatim returns null result state. Cleanup and updated the tests to reflect recent changes in ffdq. Updated the ffdq return types for all tests implemented in DwCEventDQ.

Files

FilteredPush/event_date_qc-v2.0.0.zip

Files (220.2 kB)

Name Size Download all
md5:83398a0ad6f7f19c3df1dd88c59ea4ae
220.2 kB Preview Download

Additional details