benchmark
2 published articles
AI6 min read
Climate Technology
Aimip phase 1: A new benchmark to test ai climate models
The AIMIP Phase 1 project, involving groups from NVIDIA, Google Research, and others, provides an open dataset and evaluation framework for AI climate models. While these models accurately reproduce historical climate patterns, their ability to generalize to unseen conditions remains a key challenge.
2026-07-03
AI4 min read
Benchmark
Oxford's GauntletBench puts AI agents through 100 real tasks. They failed 81% of them.
Oxford's GauntletBench puts AI agents through 100 challenging real-world tasks. Frontier systems cap out at 19.1% success, far below human performance. The benchmark targets overlooked capabilities in temporal perception, graphical understanding, and 3D reasoning across five professional applications.
2026-07-01