Arbitrage: same score, different price

Metergraph

1 min read Original article ↗

The task

Reply to this customer.

“”

Under 25 wordsNever promise a refund

What makes an A or a B?

Each AI setup wrote 20 replies: 10 support tickets, each answered twice. A reply passes if it is under 25 words and does not promise a refund.

The grade is how many of the 20 replies passed:

  • A20 of 20
  • A−19 of 20
  • B+18 of 20
  • B17 of 20

Grades only measure this task, not price. Prices are per 1,000 replies, from the Metergraph Pricing API.

Ready? You’ll have 5 seconds to memorize the board.

Select “Let’s play” when you’re ready.