Gemini 3.7 Flash, Grok 4.6, GLM-5.3 and DeepSeek V4 Pro joined the frontier

· Quesma Inc. ·

11 min read Original article ↗
AnthropicClaude Fable 5Claude CodeClaude Code01 Icy Waters solved · 4m · 277k tokens · $1.7302 Turns solved · 11m · 1.1M tokens · $4.8303 Affection solved · 3m · 229k tokens · $0.9904 Pillar Yard solved · 8m · 777k tokens · $3.6405 Brick Wall solved · 2m · 206k tokens · $0.6706 Lock solved · 6m · 795k tokens · $2.7607 Novice Locksmith solved · 6m · 695k tokens · $2.4608 Locked In solved · 5m · 396k tokens · $1.7009 Changeless solved · 3m · 213k tokens · $1.3710 Two Doors solved · 16m · 1.8M tokens · $5.9611 Jelly Throne solved · 11m · 570k tokens · $3.6612 Crab Storage solved · 12m · 1.5M tokens · $5.0013 Burglary solved · 10m · 1.1M tokens · $4.52b1 Submerged Ruins solved · 11m · 676k tokens · $3.54b2 Sunken Temple stopped · 49m · 337k tokens · $10.41142h 36m10.7M$53.25AnthropicClaude Opus 5Claude CodeClaude Code01 Icy Waters solved · 3m · 365k tokens · $0.6002 Turns solved · 16m · 940k tokens · $2.3303 Affection solved · 7m · 596k tokens · $0.8304 Pillar Yard solved · 13m · 948k tokens · $1.8805 Brick Wall solved · 5m · 255k tokens · $0.3806 Lock solved · 10m · 783k tokens · $1.4607 Novice Locksmith solved · 8m · 845k tokens · $1.0508 Locked In solved · 10m · 988k tokens · $1.4309 Changeless solved · 6m · 345k tokens · $0.5210 Two Doors solved · 45m · 2.8M tokens · $7.2611 Jelly Throne solved · 8m · 725k tokens · $1.4912 Crab Storage solved · 1h 33m · 3.2M tokens · $16.4513 Burglary solved · 12m · 862k tokens · $1.81b1 Submerged Ruins solved · 15m · 999k tokens · $2.34b2 Sunken Temple stopped · 2h 35m · 1.7M tokens · $22.12146h 46m16.3M$61.96GoogleGemini 3.7 Flash Terminus-201 Icy Waters solved · 7m · 3.4M tokens · $0.3402 Turns solved · 12m · 9.9M tokens · $0.7503 Affection solved · 3m · 520k tokens · $0.0904 Pillar Yard solved · 4m · 428k tokens · $0.0805 Brick Wall solved · 14m · 9.5M tokens · $0.7406 Lock solved · 20m · 23.7M tokens · $1.4807 Novice Locksmith solved · 4m · 627k tokens · $0.1208 Locked In solved · 5m · 1.4M tokens · $0.1909 Changeless solved · 6m · 1.4M tokens · $0.2010 Two Doors solved · 2h 47m · 385.5M tokens · $17.9811 Jelly Throne solved · 9m · 2.9M tokens · $0.3412 Crab Storage solved · 34m · 37.0M tokens · $2.1013 Burglary solved · 11m · 4.6M tokens · $0.45b1 Submerged Ruins solved · 15m · 6.1M tokens · $0.53b2 Sunken Temple failed · 4h 0m · 536.0M tokens · $30.36149h 11m1023.1M$55.76OpenAIGPT-5.6 SolCodexCodex01 Icy Waters solved · 2m · 100k tokens · $0.2902 Turns solved · 16m · 332k tokens · $0.7203 Affection solved · 4m · 87k tokens · $0.2804 Pillar Yard solved · 1h 18m · 5.4M tokens · $6.2405 Brick Wall solved · 6m · 99k tokens · $0.3106 Lock solved · 24m · 358k tokens · $0.9707 Novice Locksmith solved · 11m · 222k tokens · $0.5808 Locked In solved · 7m · 135k tokens · $0.3309 Changeless solved · 2m · 196k tokens · $0.1510 Two Doors solved · 36m · 1.3M tokens · $2.7211 Jelly Throne solved · 27m · 712k tokens · $1.5112 Crab Storage solved · 49m · 1.9M tokens · $4.0613 Burglary solved · 24m · 935k tokens · $2.33b1 Submerged Ruins solved · 37m · 432k tokens · $1.73b2 Sunken Temple failed · 3h 53m · 4.2M tokens · $9.19149h 16m16.4M$31.42OpenAIGPT-5.5CodexCodex01 Icy Waters solved · 16m · 2.3M tokens · $3.3402 Turns solved · 26m · 2.1M tokens · $5.6303 Affection solved · 6m · 246k tokens · $0.8604 Pillar Yard solved · 33m · 550k tokens · $4.4805 Brick Wall solved · 8m · 326k tokens · $1.1406 Lock solved · 30m · 1.3M tokens · $5.3507 Novice Locksmith solved · 5m · 295k tokens · $0.9508 Locked In solved · 5m · 375k tokens · $0.9009 Changeless solved · 3m · 192k tokens · $0.6510 Two Doors solved · 1h 19m · 5.3M tokens · $13.5811 Jelly Throne solved · 49m · 1.4M tokens · $8.1612 Crab Storage failed · 1h 11m · 16.5M tokens · $17.6613 Burglary solved · 44m · 6.3M tokens · $10.33b1 Submerged Ruins solved · 1h 38m · 9.2M tokens · $20.13b2 Sunken Temple failed · 1h 4m · 3.8M tokens · $8.92138h 57m50.1M$102.08GrokGrok 4.6 Terminus-201 Icy Waters solved · 21m · 340k tokens · $0.6602 Turns solved · 45m · 1.7M tokens · $2.1503 Affection solved · 4m · 85k tokens · $0.1504 Pillar Yard solved · 54m · 1.3M tokens · $2.0105 Brick Wall solved · 6m · 113k tokens · $0.1606 Lock solved · 9m · 532k tokens · $0.4907 Novice Locksmith solved · 39m · 2.5M tokens · $2.1708 Locked In solved · 8m · 523k tokens · $0.6409 Changeless solved · 14m · 489k tokens · $0.5310 Two Doors solved · 2h 52m · 7.7M tokens · $7.6011 Jelly Throne solved · 1h 18m · 1.4M tokens · $2.3812 Crab Storage solved · 3h 41m · 9.4M tokens · $9.4513 Burglary solved · 1h 4m · 3.8M tokens · $3.61b1 Submerged Ruins failed · 4h 0m · 5.2M tokens · $7.50b2 Sunken Temple failed · 4h 0m · 3.6M tokens · $6.711320h 16m38.6M$46.20DeepSeekDeepSeek V4 Pro 0813Claude CodeClaude Code01 Icy Waters solved · 2h 18m · 2.8M tokens · $0.3902 Turns solved · 46m · 4.3M tokens · $0.3803 Affection solved · 10m · 488k tokens · $0.0604 Pillar Yard solved · 1h 26m · 3.2M tokens · $0.3305 Brick Wall solved · 11m · 820k tokens · $0.0906 Lock solved · 25m · 3.7M tokens · $0.3207 Novice Locksmith solved · 27m · 2.9M tokens · $0.2208 Locked In solved · 18m · 1.4M tokens · $0.1009 Changeless solved · 15m · 822k tokens · $0.0810 Two Doors solved · 3h 35m · 16.9M tokens · $2.2511 Jelly Throne solved · 55m · 6.6M tokens · $0.5612 Crab Storage failed · 4h 1m · 15.0M tokens · $1.9513 Burglary solved · 2h 42m · 8.8M tokens · $0.78b1 Submerged Ruins solved · 2h 4m · 2.6M tokens · $0.36b2 Sunken Temple failed · 2h 35m · 5.3M tokens · $0.621322h 7m75.6M$8.48AnthropicClaude Opus 4.8Claude CodeClaude Code01 Icy Waters failed · 6m · 445k tokens · $1.1502 Turns solved · 49m · 5.5M tokens · $9.5703 Affection solved · 8m · 732k tokens · $1.4104 Pillar Yard solved · 1h 2m · 4.6M tokens · $10.9605 Brick Wall solved · 4m · 469k tokens · $0.7006 Lock solved · 17m · 2.1M tokens · $3.8107 Novice Locksmith solved · 9m · 1.2M tokens · $1.7508 Locked In solved · 9m · 989k tokens · $1.8009 Changeless solved · 10m · 1.0M tokens · $1.7910 Two Doors solved · 28m · 3.3M tokens · $5.2011 Jelly Throne solved · 44m · 5.2M tokens · $9.0112 Crab Storage failed · 1h 46m · 7.1M tokens · $23.6913 Burglary solved · 53m · 5.6M tokens · $9.53b1 Submerged Ruins solved · 1h 34m · 10.5M tokens · $20.25b2 Sunken Temple failed · 47m · 1.1M tokens · $7.15129h 7m49.9M$107.76Z.aiGLM-5.3 Terminus-201 Icy Waters solved · 50m · 207k tokens · $0.5002 Turns solved · 1h 13m · 324k tokens · $0.8103 Affection solved · 17m · 75k tokens · $0.1604 Pillar Yard solved · 1h 26m · 396k tokens · $0.9505 Brick Wall solved · 5m · 18k tokens · $0.0406 Lock solved · 38m · 175k tokens · $0.3907 Novice Locksmith solved · 1h 8m · 348k tokens · $0.7708 Locked In solved · 16m · 79k tokens · $0.1609 Changeless solved · 14m · 95k tokens · $0.1410 Two Doors solved · 3h 26m · 2.1M tokens · $2.8711 Jelly Throne solved · 1h 45m · 691k tokens · $1.2412 Crab Storage failed · 4h 1m · 2.7M tokens · $3.0113 Burglary solved · 1h 39m · 619k tokens · $1.17b1 Submerged Ruins failed · 4h 1m · 772k tokens · $2.19b2 Sunken Temple failed · 4h 1m · 954k tokens · $2.441224h 57m9.6M$16.85Z.aiGLM-5.2Claude CodeClaude Code01 Icy Waters solved · 49m · 1.7M tokens · $1.3502 Turns solved · 2h 15m · 8.3M tokens · $4.1103 Affection solved · 14m · 395k tokens · $0.3004 Pillar Yard solved · 1h 22m · 1.8M tokens · $1.6105 Brick Wall solved · 9m · 249k tokens · $0.1706 Lock solved · 35m · 1.5M tokens · $0.9607 Novice Locksmith solved · 31m · 1.7M tokens · $1.2708 Locked In solved · 42m · 1.2M tokens · $0.8009 Changeless solved · 14m · 739k tokens · $0.8910 Two Doors failed · 2h 46m · 6.2M tokens · $4.0211 Jelly Throne failed · 4h 27m · 17.0M tokens · $7.8912 Crab Storage solved · 1h 27m · 3.4M tokens · $2.3913 Burglary solved · 1h 26m · 3.6M tokens · $2.19b1 Submerged Ruins failed · 4h 33m · 11.4M tokens · $7.29b2 Sunken Temple failed · 2h 11m · 3.8M tokens · $2.291123h 41m62.9M$37.51KimiKimi K3 kimi-cli01 Icy Waters solved · 25m · 222k tokens · $0.8102 Turns failed · 4h 1m · 29.2M tokens · $14.2703 Affection solved · 25m · 1.1M tokens · $1.0704 Pillar Yard failed · 38m · 704k tokens · $1.4105 Brick Wall solved · 5m · 76k tokens · $0.1706 Lock solved · 2h 51m · 16.6M tokens · $8.4507 Novice Locksmith solved · 45m · 2.6M tokens · $2.1908 Locked In solved · 1h 37m · 10.2M tokens · $5.5009 Changeless solved · 55m · 5.3M tokens · $2.9810 Two Doors solved · 3h 36m · 13.8M tokens · $8.9811 Jelly Throne solved · 1h 2m · 379k tokens · $1.8312 Crab Storage solved · 3h 0m · 14.2M tokens · $8.5813 Burglary solved · 2h 41m · 21.1M tokens · $10.65b1 Submerged Ruins failed · 4h 0m · 4.1M tokens · $4.80b2 Sunken Temple failed · 3h 33m · 10.0M tokens · $6.461129h 34m129.5M$78.15GoogleGemini 3.1 Pro Terminus-201 Icy Waters solved · 4m · 54k tokens · $0.3902 Turns failed · 9m · 96k tokens · $1.0403 Affection solved · 3m · 74k tokens · $0.3404 Pillar Yard solved · 10m · 104k tokens · $1.0605 Brick Wall solved · 2m · 22k tokens · $0.1606 Lock failed · 53m · 597k tokens · $5.5407 Novice Locksmith solved · 4m · 49k tokens · $0.4108 Locked In solved · 7m · 79k tokens · $0.6909 Changeless solved · 4m · 62k tokens · $0.4410 Two Doors failed · 14m · 145k tokens · $1.5411 Jelly Throne failed · 35m · 369k tokens · $3.6112 Crab Storage failed · 8m · 76k tokens · $0.8313 Burglary failed · 15m · 149k tokens · $1.57b1 Submerged Ruins solved · 49m · 533k tokens · $4.96b2 Sunken Temple failed · 2h 20m · 39.4M tokens · $35.5985h 58m41.8M$58.17GoogleGemini 3.6 Flash Terminus-201 Icy Waters stopped · 38m · 106.2M tokens · $25.9402 Turns failed · 52m · 31.6M tokens · $10.1603 Affection solved · 4m · 896k tokens · $0.8604 Pillar Yard solved · 20m · 22.4M tokens · $7.7005 Brick Wall solved · 3m · 398k tokens · $0.5106 Lock stopped · 55m · 207.8M tokens · $44.3507 Novice Locksmith stopped · 58m · 192.4M tokens · $43.0408 Locked In solved · 4m · 508k tokens · $0.5409 Changeless solved · 2m · 72k tokens · $0.1010 Two Doors stopped · 54m · 141.2M tokens · $35.1111 Jelly Throne stopped · 6m · 1.2M tokens · $1.1312 Crab Storage solved · 7m · 1.2M tokens · $1.3813 Burglary stopped · 58m · 151.3M tokens · $35.70b1 Submerged Ruins stopped · 58m · 150.1M tokens · $35.69b2 Sunken Temple stopped · 47m · 110.9M tokens · $27.2967h 46m1118.1M$269.48DeepSeekDeepSeek V4 Flash 0731Claude CodeClaude Code01 Icy Waters solved · 30m · 2.4M tokens · $0.1202 Turns solved · 3h 49m · 17.2M tokens · $1.2803 Affection failed · 35m · 1.6M tokens · $0.0404 Pillar Yard failed · 1h 40m · 4.3M tokens · $0.3105 Brick Wall solved · 22m · 649k tokens · $0.0306 Lock failed · 10m · 50k tokens · $0.0007 Novice Locksmith solved · 4h 57m · 20.8M tokens · $0.6408 Locked In solved · 36m · 4.8M tokens · $0.1909 Changeless solved · 38m · 1.7M tokens · $0.0710 Two Doors failed · 1h 28m · 9.2M tokens · $0.4511 Jelly Throne failed · 1h 39m · 8.6M tokens · $0.3212 Crab Storage failed · 1h 17m · 3.4M tokens · $0.1513 Burglary failed · 1h 30m · 3.4M tokens · $0.10b1 Submerged Ruins failed · 23m · 1.2M tokens · $0.04b2 Sunken Temple failed · 4h 36m · 13.5M tokens · $0.55624h 11m92.8M$4.31