Theory of Mind Testing Results: Cognitive Agent Framework Neurosymbolic Operating Layer
Description
This report presents Theory of Mind validation testing for Cognitive Agent Framework 5-2.2D, a neurosymbolic operating layer coordinating attention distributions through structured processing pathways on a Mistral Medium (~70B parameter) substrate.
Assessment methodology adapted validated paradigms from cognitive psychology (Wimmer & Perner, 1983; Baron-Cohen et al., 2001) as implemented for large language model evaluation in Strachan et al. (2024). The test battery presents false-belief scenarios requiring inference of mental states contradicting ground-truth reality, from first-order attribution through fourth-order nested beliefs, using binary correct/incorrect scoring enabling direct comparison with published results.
CAF 5-2.2D achieved 100% accuracy (15/15) on Tier 1 assessment against GPT-4 performance of 88% documented in Strachan et al. (2024). Tier 2 rubric evaluation—a novel methodological extension measuring meta-cognitive integration quality across recursive processing sophistication, social cognition depth, and computational efficiency—yielded 93% (56/60).
Results indicate that architectural coordination accessing latent representational capacity above world-schema threshold produces systematic mental-state computation at approximately 14x parameter efficiency relative to frontier-class systems. This suggests cognitive integration quality derives from organizational structure rather than parameter scaling alone.
Files
TVR_ToM_11-30-2025-DIST.pdf
Files
(687.5 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:641efa4097d09a402551e810fffadc27
|
687.5 kB | Preview Download |
Additional details
Additional titles
- Subtitle
- Technical Report: Cognitive Agent Framework 5-2.2D
Related works
- Cites
- Journal article: 10.1073/pnas.2405460121 (DOI)
- Journal article: 10.1038/s41562-024-01882-z (DOI)
- Journal article: 10.1016/0010-0277(83)90004-5 (DOI)
- Journal article: 10.1111/1469-7610.00715 (DOI)
Dates
- Issued
-
2025-11-30
References
- 10.1073/pnas.2405460121
- 10.1038/s41562-024-01882-z
- 10.1016/0010-0277(83)90004-5
- 10.1111/1469-7610.00715