There is a newer version of the record available.

Published May 7, 2025 | Version v0.25
Software Open

LucaCanali/sparkMeasure: sparkMeasure v0.25

Authors/Creators

  • 1. Banana Coding
  • 2. Alphonso Inc.
  • 3. Knowledge Lens
  • 4. Grab
  • 5. @platform9
  • 6. Featurespace

Description

Release 0.25, Highlights

🚀 Improvements

  • Improved Documentation: Clearer setup and usage instructions.
  • Memory Report Enhanced: More robust error handling in StageMetrics.
  • Updated Flight Recorder Mode: Simplified configuration and examples.
  • Wider Compatibility: Supports Java 11 & 17, Scala 2.12 & 2.13, Spark 3.x & 4.x, Python 3.9 to 3.12.

🐛 Bug Fixes

  • Fixed Kafka Sink Errors.
  • Corrected Memory Reporting in StageMetrics.
  • Improved JSON Print for Flight Recorder.
  • Enhanced Python API Error Handling.

📥 Installation

  • Scala:

    spark-shell --packages ch.cern.sparkmeasure:spark-measure_2.12:0.25

  • Python:

    pip install sparkmeasure
pyspark --packages ch.cern.sparkmeasure:spark-measure_2.12:0.25

Files

LucaCanali/sparkMeasure-v0.25.zip

Files (298.1 kB)

Name Size Download all
md5:bdb396e4b2f9d17b461416294d52691b
298.1 kB Preview Download

Additional details

Related works

Is supplement to
Software: https://github.com/LucaCanali/sparkMeasure/tree/v0.25 (URL)

Software

Repository URL
https://github.com/LucaCanali/sparkMeasure