There is a newer version of the record available.

Published February 15, 2024 | Version v0.10.1

Xilinx/brevitas: Release v0.10.1

Description

Highlights

  • A2Q+ support paper
  • A2Q+ examples with CIFAR10 and Super Resolution
  • Support for concatenation equalization for weights and activations
  • Support for GPFQ + A2Q L1 Norm bound
  • Possibility to explicitly export Q node for weights in QCDQ export
  • Support for float16 and bfloat16 for QCDQ export
  • Support for Dynamic Activation Quantization for ONNX QDQ export
  • Support for channel-splitting paper
  • (Beta) Better compatibility with Huggingface accelerate and optimum
  • (Beta) Improved support and testing for minifloat quantization

What's Changed

  • Fix (examples/generative): set weight_bit_width in weight_quant by @Giuseppe5 in https://github.com/Xilinx/brevitas/pull/783
  • Feat (graph/equalize): improvements for llm equalization by @Giuseppe5 in https://github.com/Xilinx/brevitas/pull/784
  • [graph] Fix typo in class name by @nickfraser in https://github.com/Xilinx/brevitas/pull/765
  • Fix (graph/equalize): refactor for act equalization by @Giuseppe5 in https://github.com/Xilinx/brevitas/pull/787
  • [quant_tensor] Updates __truediv__ behaviour to match "standard fixed point rules" by @nickfraser in https://github.com/Xilinx/brevitas/pull/769
  • Feat (export): (b)float16 support for qcdq export by @Giuseppe5 in https://github.com/Xilinx/brevitas/pull/776
  • Feat (ptq): Adding A2Q Upper Bound clipping to GPFQ by @fabianandresgrob in https://github.com/Xilinx/brevitas/pull/734
  • Extended equalization by @Giuseppe5 in https://github.com/Xilinx/brevitas/pull/778
  • Better Bfloat16 support by @Giuseppe5 in https://github.com/Xilinx/brevitas/pull/777
  • Fix (stats): add return statement in state_dict by @Giuseppe5 in https://github.com/Xilinx/brevitas/pull/792
  • Fix (equalize): improved cat eq checks by @Giuseppe5 in https://github.com/Xilinx/brevitas/pull/793
  • Fix (export): add CastMixin by @Giuseppe5 in https://github.com/Xilinx/brevitas/pull/794
  • Dynamic Act Quant support by @Giuseppe5 in https://github.com/Xilinx/brevitas/pull/796
  • Fix (examples/quantizers): correct dynamic zero point handling by @Giuseppe5 in https://github.com/Xilinx/brevitas/pull/806
  • Feat (a2q+): improving accumulator-aware weight quantization by @i-colbert in https://github.com/Xilinx/brevitas/pull/797
  • Feat (a2q+): adding new super resolution models to brevitas_examples by @i-colbert in https://github.com/Xilinx/brevitas/pull/811
  • Feat (Channel-Splitting): sets up first skeleton for channel-splitting by @fabianandresgrob in https://github.com/Xilinx/brevitas/pull/772
  • Feat: support for optimum by @Giuseppe5 in https://github.com/Xilinx/brevitas/pull/826
  • Fix (tests): adding tests for FloatQuant by @fabianandresgrob in https://github.com/Xilinx/brevitas/pull/815
  • Fix (export): correct q node export by @Giuseppe5 in https://github.com/Xilinx/brevitas/pull/829
  • Fix (examples/llm): correct groupwise export by @Giuseppe5 in https://github.com/Xilinx/brevitas/pull/832
  • Fix (examples/super_res): updating README by @i-colbert in https://github.com/Xilinx/brevitas/pull/828
  • Fix (examples/export): improved export by @Giuseppe5 in https://github.com/Xilinx/brevitas/pull/838
  • Fix (graph/equalize): cleanup and device management by @Giuseppe5 in https://github.com/Xilinx/brevitas/pull/840
  • Feat (examples/a2q): adding CIFAR10 example by @i-colbert in https://github.com/Xilinx/brevitas/pull/813
  • Fix (export): check for Per Group quantization by @Giuseppe5 in https://github.com/Xilinx/brevitas/pull/848

Full Changelog: https://github.com/Xilinx/brevitas/compare/v0.10.0...v0.10.1

Files

Xilinx/brevitas-v0.10.1.zip

Files (3.3 MB)

Name Size Download all
md5:64f6083ef84d867e8f5403703f011bc6
3.3 MB Preview Download

Additional details

Related works

Is supplement to
Software: https://github.com/Xilinx/brevitas/tree/v0.10.1 (URL)