AA-PersonalityBench: AI Personality & Communication Style Benchmark | Artificial Analysis

2 min read Original article ↗

Personality Indexes

Each index takes the mean of its traits’ Elo z-scores, then percentile ranks it from 1 to 100 across all models evaluated in the benchmark.

How Traits Form Personality Indexes

30 questions per personality trait (900 questions total), judged by a panel of models. Each index z-scores its traits’ Elo ratings, inverts traits where needed, calculates the mean, and percentile ranks the result from 1 to 100 across all models evaluated in the benchmark.

Example Questions, Responses, and Grading

Detailed Personality Trait Results

All 30 judged personality traits which comprise the 8 indexes.

Personality Trait Leaderboards

Each trait’s Elo percentile ranked from 1 to 100 across all models evaluated in the benchmark. Overall tabs show the index: the mean of its traits’ Elo z-scores, percentile ranked the same way. Whiskers show each model’s 95% confidence interval on the same scale.

Compare Model Personalities

Compare any two models: each bar shows the probability one model’s answer is judged to show more of that trait, based on their Elos.

Emergent Model Families & Clusters

Models grouped by how alike their judged traits and communication characteristics are, using average-linkage clustering on the correlation between z-scores.

Build Your Own Personality Ranking

Pick any of the 30 traits and weight them from −2 to +2. Your traits’ Elo z-scores are combined as a weighted mean, then percentile ranked from 1 to 100 across all models evaluated in the benchmark.

Communication Characteristics

21 metrics measured directly from each response, separate from the judged traits above. Cells show the average per response, colored by its percentile rank across all models evaluated in the benchmark.

Model Fingerprints

Each model’s strongest and weakest signals, as standard deviations (σ) above (+) or below (−) the average across models.