This researcher has a new way to measure AI performance. It's BS, literally.

Peter Gostev, AI capability lead at Arena Peter Gostev Peter Gostev's BullshitBench tests AI models with nonsensical questions to spot BS detection. Google Gemini 3.0 struggles with BullshitBench, failing to reject nonsense over half the time. One AI company did way better than everyone else. A new AI benchmark asks a deceptively simple question: Can machines tell when something is, well, BS? Peter Gostev, AI capability lead at model-evaluation firm Arena, recently created "BullshitBench," ...