Settings

Theme

Artificial Analysis Intelligence Index v5

artificialanalysis.ai

2 points by thefourthchime · 2 comments

Reader

2 threads
thefourthchimeOP

featuring 2 new benchmarks and 3 upgrades. For the first time, the majority of the Index is built on private datasets

The Artificial Analysis Intelligence Index is our composite measure of model capabilities across tasks reflecting real-world usage today. v5 is our biggest upgrade since v4 launched in January. With v5, 60% of the Index is now based on evaluations with private test sets or held-out answers.

Alongside Intelligence Index v5, we’re launching the Artificial Analysis Progress Index v1, which tracks model capability over time on one continuous scale.

ChrisArchitect

[dupe] https://news.ycombinator.com/item?id=50268868

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection