AEC-Bench: A Multimodal Benchmark for Agentic Systems in Architecture, Engineering, and Construction
The AEC-Bench is a multimodal benchmark for evaluating agentic systems on real-world tasks in the Architecture, Engineering, and Construction (AEC) domain. The benchmark covers tasks requiring drawing understanding, cross-sheet reasoning, and construction project-level coordination. This report describes the benchmark motivation, dataset taxonomy, evaluation protocol, and baseline results across several domain-specific foundation model harnesses. We use AEC-Bench to identify consistent tools and harness design techniques that uniformly improve performance across foundation models in their own base harnesses, such as Claude Code and Codex. We openly release our benchmark dataset, agent har...
| Authors | Harsh Mankodiya, Chase Gallik, Theodoros Galanos et al. |
|---|---|
| Primary category | cs.AI |
| Published | 31 March 2026 |
| Last updated at source | 31 March 2026 |
Connected in the knowledge graph
- nomic-ai/aec-benchDataset · cited by
Models and datasets referencing this paper
- nomic-ai/aec-benchDataset
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.