Tag

#AI benchmarks

7 articles

Anthropic's Claude Fable 5 dominates new industry benchmarks at a steep premium

Anthropic's Claude Fable 5 leads industry benchmarks in finance, law, and medicine, but its $3.48 per task price tag is over 100 times more than competitors like DeepSeek V4 Pro.

Jul 84

Inside Genebench-Pro

OpenAI introduces Genebench-Pro, a new benchmark for evaluating large language models' biological and medical understanding capabilities. The tool aims to advance AI applications in healthcare and scientific research.

Jun 3031

Fable 5 was beating GPT 5.5 on every major benchmark. Then the US government pulled it offline.

Anthropic's Fable 5 briefly outperformed OpenAI's GPT-5.5 before being shut down by the U.S. government, sparking speculation about national security concerns and AI regulation.

Jun 1449

GPT-5.5 tops benchmarks but still hallucinates frequently at a 20 percent higher API cost

GPT-5.5 tops AI benchmarks but still hallucinates frequently, and its API cost has risen by 20%.

Apr 2664

Alibaba's open model Qwen3.6 leads Google's Gemma 4 across agentic coding benchmarks

Alibaba's Qwen3.6 outperforms Google's Gemma 4 in agentic coding benchmarks, showcasing the power of efficient AI architectures.

Apr 1762

AI benchmarks systematically ignore how humans disagree, Google study finds

This article explains how human disagreement in AI benchmarking can lead to unreliable performance metrics and why current practices need to evolve to account for annotation variability.

Apr 4111

Cohere releases open source model that tops speech recognition benchmarks

Cohere has released an open-source speech recognition model that outperforms industry leader OpenAI's Whisper in benchmark tests.

Mar 27100