There is a newer version of the record available.

Published December 2, 2025 | Version v1

Quantized Prediction Models: Output-Space Regularization for Stable and Interpretable Regression

Description

We introduce Quantized Prediction Models (QPMs), a regression framework
that constrains predictions to a finite set of output levels. Unlike
traditional parameter-based regularization, QPMs regularize directly in
the \emph{output space} through supervised quantization, creating a
functional bottleneck that suppresses noise, improves stability, and
produces discrete, monotone predictors suited for governance-sensitive
domains.

QPMs employ an optimizer-driven binning procedure that concentrates
resolution around high-stakes decision thresholds while maintaining a
globally coherent, interpretable score ladder. To address distributional
drift, we propose an Anchored Calibration update that adjusts bin
representatives while keeping bin edges fixed, thereby guaranteeing
zero rank-order churn.

Theoretically, QPMs reduce local sensitivity, decrease variance, and
preserve monotonicity under anchored updates. Empirically, they match the
predictive performance of standard gradient boosting models while
delivering dramatically improved stability, offering a practical,
governance-aligned alternative for applications in which stability is as
critical as accuracy. The methods described are fully specified in the
text.

Files

Quantized_Prediction_Models.pdf

Files (425.9 kB)

Name Size
md5:dd9049b0c01c2a4b26a3a51ba43ff849
425.9 kB Preview Download