benchLANG is a reproducible cross-language runtime benchmark comparing 18 languages across prime sieve, recursive Fibonacci, string lookup, Mandelbrot, and binary tree workloads using pinned Nix ...

Speechify's Simba 3.2 ranked No. 1 on two independent voice AI benchmarks this week, beating ElevenLabs and Cartesia on ...

Software engineering is going through its most dramatic transformation in years.

Developers are increasingly relying on large language models (LLMs) for everyday computing tasks such as fixing bugs, ...

The 53rd annual conference presents peer-reviewed breakthroughs in simulation, vectorization, and physics modeling across ...

AI coding benchmark MirrorCode published its full results June 26, showing Claude Opus 4.7 autonomously rebuilt a 60,000-line interpreter and scored 56% overall — completing tasks that take human ...

AI coding benchmark scores that labs, enterprises, and investors use to compare frontier models are inflated by answer retrieval — not genuine reasoning — and the smarter the model, the more inflated ...

Moonshot AI just dropped Kimi-K2.7-Code, an open-source coding model that wants to make AI-assisted programming less wasteful and more capable. The Beijing-based company claims the model cuts ...

DeepSWE, created by DataCurve offers a benchmark for assessing AI coding models by focusing on real-world programming challenges rather than synthetic test cases. According to Matthew Berman, one of ...

Tests of how well 19 large language models (LLMs) complete and perform complicated multi-step tasks has shown that they are both error-prone and, in many cases, unreliable. They said that the ...

Amazon Web Services Inc. today made OpenAI Group PBC’s large language models available on its cloud platform. The algorithms are accessible through Amazon Bedrock alongside Codex, the ChatGPT ...