Published August 6, 2026 | Version v1

Physics as the label for measuring and correcting materials reasoning in multimodal models

  • 1. ROR icon Hamad bin Khalifa University
  • 2. ROR icon Technical University of Munich
  • 3. Ankara University

Description

Vision-language and language models increasingly interpret materials data, yet benchmarks report that they hallucinate invalid properties and violate physical law. Evaluation matches final answers to scarce human labels, while discovery agents verify final proposals or density functional theory (DFT) execution. Neither measures the physical consistency of a model's reasoning chain. Materials data carries its own physics, making a large class of materials reasoning verifiable without annotation. We introduce MatPCR, a label-free benchmark whose programmatic oracles check diffraction geometry through Bragg's law, scale bars, spectral peaks, and DFT-grounded stability, metallicity and property magnitude. We define the Physical-Consistency Rate over image and structure inputs; introduce Constraint-Grounded Self-Verification, an agentic loop whose gain survives self-refinement and equal-compute re-prompting controls; release an open verifier useful in distribution but near chance on all six held-out constraint types; and derive an exact identity for how oracle error displaces the reported rate.

Files

magnetism_halfB_review_2026-08-06.txt

Files (8.9 MB)

Name Size
md5:c3247b2b57a11a58355db9db245c8324
267.4 kB Download
md5:5f6ded784329accf5e518dd6568a3fe2
34.0 kB Download
md5:f57bd406d6471711e674df00474edeb2
51.0 kB Download
md5:a722551cb6c6e9d8c4349bd26d4b95b0
328.2 kB Download
md5:f8306b5f1f64e7bd650334cd04c8c29b
304.7 kB Download
md5:9a37b2fe56d6f54168f26fa6d625f260
405.2 kB Download
md5:afaf967daed3dd36105ec8187e41f825
175.0 kB Download
md5:c24eb525835918f74eb519340d233cb0
141.9 kB Download
md5:08ae38dfd41c031af4bcefc4070349a0
115.6 kB Download
md5:974d76a432802b78e983ef3fb71d1873
114.4 kB Download
md5:c7bf986ea8e25849fee4f8f729b891ca
2.0 MB Download
md5:351a88d5e04576beb14dbbe176565dcc
430.3 kB Download
md5:aef9d65254db957c196e29a8086f2328
4.3 kB Download
md5:d19ca62ce759bbb1ec1d4d0f41a844ff
1.7 MB Download
md5:5509fa031930d34d79f2df36792949f6
574.6 kB Download
md5:4deadae2d1c5240d02bb3e3d81204e0f
1.7 MB Download
md5:265f7216f617c114c77b53c4cb03e5bf
6.7 kB Preview Download
md5:1ce2de749c2b40f952096ef9bbc8244c
6.6 kB Preview Download
md5:0ea165847c176c33cd8e27f8cbe1cba0
1.1 kB Preview Download
md5:a220c7ced0a4ae0b2126c23f91985e76
27.5 kB Download
md5:73c5cdc565ff07ec1672fda699aa43df
11.5 kB Download
md5:150fdb34609be1dd456814eabde977b9
16.9 kB Download
md5:a862ffcd669385363f5eedc71f9e04a2
16.9 kB Download
md5:e7b9237db119be6f1ed9ba8183db5bda
103.9 kB Download
md5:daa2d67ed533e69c1d5a93c998621979
108.6 kB Download
md5:3e6568708be5d2855ab74ce8b03ec098
8.8 kB Download
md5:259ccf13cd78bb024b7f84b7a3a9f42d
4.7 kB Download
md5:29837f46ec65c2bcf8a0b4974c285623
1.2 kB Download
md5:be7fe76d92aa01da0aacf9b393c1337c
35.6 kB Download
md5:e38a3403fb14d3236c2e83683376a2b6
31.2 kB Download
md5:45f58ff3ba9430dab4ca042cf56b43e7
68.1 kB Download
md5:224d48427cc1756cebc4abac4f8afaa4
2.8 kB Preview Download
md5:dee69bc9967447f19928ce2362c41492
6.4 kB Preview Download
md5:1e142d1d6d4a97a8519469dcf6bb8975
90.1 kB Download
md5:5b6fe2016d5c395916d391a5033c08a8
28.0 kB Preview Download
md5:2a346d1092984bdc37cc24e0145fdd7d
6.2 kB Preview Download
md5:1ee751850392f4853a64fb4b3b00faf8
6.2 kB Preview Download

Additional details