Published May 15, 2025 | Version v1

A Foundation Model for Consumption, Transactions, and Actions: The Inception of BehaviorGPT

  • 1. Unbox AI

Description

We present BehaviorGPT-v1, a foundation model for grocery consumption built by applying language modeling techniques to large-scale consumer data. By treating each user's purchase history as a sequence of tokens—"the language of grocery consumption"—we trained a Transformer capable of predicting future consumption patterns. Our dataset spans approximately 600M online actions and 15B offline grocery purchases. The resulting 150M-parameter model incorporates architectural modifications tailored to the unique challenges of this tokenization. We position this work as a step toward a broader foundation model for payments, retail, and ultimately human behavior—what we call BehaviorGPT.

Notes

Technical report, Unbox AI. The work was done in 2020 and 2021. The supplementary file 2021-06-22-Data-and-Model-Sketch.pdf contains the original June 2021 data and model sketches, one of the source documents listed in the report.

Files

foundation-model-for-consumption-transactions-and-actions.pdf

Files (5.8 MB)

Name Size
md5:4061544abfea798c48b153070fca050e
1.8 MB Preview Download
md5:f3acd1c1e7a409e344c282e404c7ee97
4.1 MB Preview Download

Additional details