A Benchmark for Evaluating Large Language Models in Structural Engineering

This record contains Release 1.0 of an English-normalized benchmark for evaluating large language models in structural engineering.

 

The benchmark contains 300 base tasks and 800 executable instances organized into three difficulty levels: foundational, intermediate, and advanced. The tasks cover equilibrium and internal actions, trusses, section stresses, reinforced concrete, instability and second-order effects, influence lines, structural dynamics, wave and site-response reasoning, torsion and shear-centre interpretation, structural health monitoring, and post-earthquake judgement.