There is a newer version of the record available.

Published May 26, 2020 | Version v1.0.0

RADAR-base/Restructure-HDFS-topic: radar-output-restructure version 1.0.0

  • 1. @thehyve
  • 2. @RADAR-base @KHP-Informatics

Description

Changes since radar-hdfs-restructure version 0.6.0:

  • Added storage drivers for S3 API input and output
  • Storage is more consistent to configure
  • Changed synchronisation and accounting to be handled with Redis
    • With more consistent locking
    • Faster write times
    • Redis is required.
  • Added integration tests
  • Configurable automatic deletion after a threshold amount of time, to avoid storage filling up.
  • Reprocesses files that were modified after the last processed modification time.
  • Customizable time bin format

Files

RADAR-base/Restructure-HDFS-topic-v1.0.0.zip

Files (179.1 kB)

Name Size
md5:e96c64b93a3d62243ef8fb26bc28df96
179.1 kB Preview Download

Additional details