There is a newer version of the record available.

Published July 23, 2025 | Version v0.2
Software Open

cwida/PDX: v0.2

Authors/Creators

  • 1. CWI
  • 2. Radboud University

Description

  • New feature: Scalar Quantization with 8 bits on PDX+ADSampling. We calculate distances in 8-bits (symmetric calculations) instead of decoding to floats.
  • New algorithm: IVF<sub>2</sub>, A Two-level IVF index that reduces the time to find the nearest centroids in larger collections. Achieves extremely high throughputs when paired with SQ8. Check some benchmarks here.
  • Improvements to the PDX data layout to tackle the poor performance gains when K > 10. Read more here. This new layout substantially reduce I/O on the PRUNE phase of the algorithm.
  • Added new datasets from the VIBE benchmark.
  • Created a playground to test the raw performance of PDX vs SIMD kernels.
  • Removing unnecessary code from SIGMOD experiments.
  • Added MIT LICENCE.
  • Improved README.
  • Improved examples.

Files

cwida/PDX-v0.2.zip

Files (182.6 MB)

Name Size Download all
md5:a4d7c21b1ce39155bf6e0ac76f4f6332
182.6 MB Preview Download

Additional details

Related works

Is supplement to
Software: https://github.com/cwida/PDX/tree/v0.2 (URL)

Software

Repository URL
https://github.com/cwida/PDX