A new community-driven initiative evaluates large language models using Italian-native tasks, with AI translation among the ...

In the first evaluation of the "National Representative AI," it was revealed that individual benchmarks selected by each company, in addition to common benchmarks, were introduced as criteria for ...

Beijing-based Ubiquant launches code-focused systems claiming benchmark wins over US peers despite using far fewer parameters ...

This study introduces MathEval, a comprehensive benchmarking framework designed to systematically evaluate the mathematical reasoning capabilities of large language models (LLMs). Addressing key ...

Artificial intelligence has traditionally advanced through automatic accuracy tests in tasks meant to approximate human knowledge. Carefully crafted benchmark tests such as The General Language ...

Large language models frequently misrepresent verbal risk terms used in medicine, potentially amplifying patient misunderstandings and diverging from established clinical definitions, according to a ...

The testing sparked internal frustration about the progress of the Llama models. Yann LeCun, Meta’s outgoing chief AI ...

Joining the ranks of a growing number of smaller, powerful reasoning models is MiroThinker 1.5 from MiroMind, with just 30 ...

Open-weight LLMs can unlock significant strategic advantages, delivering customization and independence in an increasingly AI ...