Published March 9, 2026 | Version v1
Preprint Open

A Computational Pipeline for Quantifying Longitudinal Cognitive Dynamics in Sustained Human–LLM Interaction

  • 1. Independent

Description

Most research on human–LLM interaction examines discrete task performance at single time points. How sustained collaboration with an LLM evolves over months - and whether it leaves measurable cognitive traces - remains empirically uncharacterised. We present an open-source computational pipeline for quantifying longitudinal cognitive dynamics, demonstrated on a naturalistic corpus of 20,449 messages spanning eight months of ChatGPT interaction (64 conversation threads, single participant). The pipeline applies lexical cognitive profiling, topic modelling, dyadic alignment measurement, and vocabulary analysis at monthly resolution, validating all trends against permutation null distributions. Applied to the demonstration corpus, the framework detected coherent longitudinal structure across five measures: progressive growth in structural reasoning language, a non-monotonic epistemic uncertainty arc, an eightfold increase in exchange density, vocabulary narrowing, and stable conversation linearityconsistent with progressive domain specialisationThese findings demonstrate the pipeline's sensitivity to meaningful longitudinal dynamics. The full pipeline is openly available for application to any ChatGPT/Claude export. 

Files

Files (1.6 MB)

Name Size Download all
md5:551aa6a1f91f0cef725815783e232c5b
331.2 kB Download
md5:9cba6ffc1669cf19d6752a6202476efc
1.3 MB Download

Additional details

Software

Repository URL
https://github.com/RayanBVasse/DOL
Development Status
Active