Published November 30, 2025 | Version 1.0

Theory of Mind Testing Results: Cognitive Agent Framework Neurosymbolic Operating Layer

  • 1. Crafted Logic Lab

Description

This report presents Theory of Mind validation testing for Cognitive Agent Framework 5-2.2D, a neurosymbolic operating layer coordinating attention distributions through structured processing pathways on a Mistral Medium (~70B parameter) substrate.

Assessment methodology adapted validated paradigms from cognitive psychology (Wimmer & Perner, 1983; Baron-Cohen et al., 2001) as implemented for large language model evaluation in Strachan et al. (2024). The test battery presents false-belief scenarios requiring inference of mental states contradicting ground-truth reality, from first-order attribution through fourth-order nested beliefs, using binary correct/incorrect scoring enabling direct comparison with published results.

CAF 5-2.2D achieved 100% accuracy (15/15) on Tier 1 assessment against GPT-4 performance of 88% documented in Strachan et al. (2024). Tier 2 rubric evaluation—a novel methodological extension measuring meta-cognitive integration quality across recursive processing sophistication, social cognition depth, and computational efficiency—yielded 93% (56/60).

Results indicate that architectural coordination accessing latent representational capacity above world-schema threshold produces systematic mental-state computation at approximately 14x parameter efficiency relative to frontier-class systems. This suggests cognitive integration quality derives from organizational structure rather than parameter scaling alone.

Files

TVR_ToM_11-30-2025-DIST.pdf

Files (687.5 kB)

Name Size Download all
md5:641efa4097d09a402551e810fffadc27
687.5 kB Preview Download

Additional details

Additional titles

Subtitle
Technical Report: Cognitive Agent Framework 5-2.2D

Related works

Cites
Journal article: 10.1073/pnas.2405460121 (DOI)
Journal article: 10.1038/s41562-024-01882-z (DOI)
Journal article: 10.1016/0010-0277(83)90004-5 (DOI)
Journal article: 10.1111/1469-7610.00715 (DOI)

Dates

Issued
2025-11-30

References

  • 10.1073/pnas.2405460121
  • 10.1038/s41562-024-01882-z
  • 10.1016/0010-0277(83)90004-5
  • 10.1111/1469-7610.00715