Published June 4, 2026 | Version v1

Recompile, Don't Transport: Empirical Validation of Data-Driven Personalization Updates on Edge-Class Hardware

Authors/Creators

Description

Adapter-based personalization (e.g., LoRA) does not survive base-model change. We test this
directly: across 12 users from the Enron corpus and two base models from the same family
(Qwen2.5-1.5B-Instruct → Qwen2.5-3B-Instruct), adapter transport fails universally with tensor-
shape mismatch (12/12 users). Recompiling a fresh adapter from the same user data on the new
base fully recovers personalization at 250 training examples and exceeds the original adapter at 500
examples (fingerprint distance 0.83 vs 0.86; authorship probability 0.51 vs 0.44). Recompilation
takes 47–163 seconds on an A100 and is operationally viable on edge-class hardware. We argue
the durable asset for on-device personalization is therefore the source data and a frozen per-user
evaluation set, not the adapter — a requirement mechanically incompatible with closed-weight
deployment. This is the second paper in a research program arguing that durable personalization
is one of several structural reasons the on-device LLM future will be open-weight.

Files

Recompile, Dont Transport.Colby Philbin.pdf

Files (472.2 kB)

Name Size Download all
md5:b7603e099e78fb9e8633a4e74c6d70df
472.2 kB Preview Download