Published February 1, 2022 | Version v1
Journal article Open

Integration of OSN-NSDF data movements

  • 1. Johns Hopkins University

Description

The “First Meter” Problem:

  • High-throughput instruments have an impedance problem
  • Both for data rate (few TB/min) and data volume (PB)
  • Data needs to be first captured at a high rate and then transferred to an HPC center for processing (where it is free)

This can be solved with multiple dedicated local pods acting as high-capacity caches with a customizable NSDF software layer on the back end (compression, data transform).

Files

Files (24.2 MB)

Name Size Download all
md5:e250c2c1498dcfad5039d27194a9cda4
24.2 MB Download