gpt-oss-120B (high): API Provider Performance Benchmarking & Price Analysis | Artificial Analysis

3 min read Original article ↗

Highlights

Output Tokens per Second; Higher is better

USD per 1M Tokens; Lower is better

Update: Default performance benchmarking workload has updated to 10k input tokens to better reflect production use cases. You can still select different workloads above!

Pricing

Speed

Measured by Output Speed (tokens per second)

Latency

Measured by Time (seconds) to First Token

End-to-End Response Time

Seconds to output 500 Tokens, calculated based on time to first token, 'thinking' time for reasoning models, and output speed

API Features

Endpoint Evaluations

Summary Table of Key Comparison Metrics

Frequently Asked Questions

Common questions about gpt-oss-120B (high) providers

gpt-oss-120B (high) is available through 23 API providers: Cerebras, Parasail, Databricks, Azure, Baseten, SambaNova, Amazon, Together.ai, Lightning AI, DeepInfra (Turbo), Google Vertex, Snowflake, Groq, Clarifai, DeepInfra, Weights & Biases, Novita, Fireworks, Scaleway, Nebius Fast, Cloudflare, Nebius Base, and Eigen AI. Each provider offers different performance characteristics and pricing.

gpt-oss-120B (high) is currently available through 23 API providers that we benchmark and track.

The fastest providers for gpt-oss-120B (high) by output speed are Cerebras (1,861.5 t/s), Eigen AI (781.6 t/s), and Nebius Fast (718.4 t/s). Output speed measures how quickly tokens are generated after the model starts responding.

The providers with the lowest time to first token for gpt-oss-120B (high) are Google Vertex (0.36s), Clarifai (0.42s), and Baseten (0.45s). Lower latency means faster initial response time.

The most affordable providers for gpt-oss-120B (high) by blended price are DeepInfra ($0.08 per 1M tokens), Novita ($0.10 per 1M tokens), and Google Vertex ($0.16 per 1M tokens). Blended price uses a 3:1 input to output token ratio.

The providers with the lowest input token pricing for gpt-oss-120B (high) are DeepInfra ($0.04 per 1M input tokens), Novita ($0.05 per 1M input tokens), and Google Vertex ($0.09 per 1M input tokens).

The providers with the lowest output token pricing for gpt-oss-120B (high) are DeepInfra ($0.19 per 1M output tokens), Snowflake ($0.22 per 1M output tokens), and Novita ($0.25 per 1M output tokens).

Prices for gpt-oss-120B (high) vary up to 5.9x across providers. The most affordable is DeepInfra at $0.08 per 1M tokens, while Cerebras charges $0.45 per 1M tokens.

Output speed for gpt-oss-120B (high) varies significantly across providers. Cerebras is the fastest at 1,861.5 t/s, which is 45.3x faster than DeepInfra at 41.1 t/s.

17 of 23 providers support function calling for gpt-oss-120B (high): Cerebras, Databricks, Azure, Baseten, SambaNova, Amazon, Together.ai, Lightning AI, Google Vertex, Groq, Clarifai, DeepInfra, Novita, Fireworks, Nebius Fast, Cloudflare, and Eigen AI.

The best provider for gpt-oss-120B (high) depends on your priorities: Cerebras offers the highest output speed, Google Vertex has the lowest latency, and DeepInfra provides the most competitive pricing.

When choosing a provider for gpt-oss-120B (high), consider: output speed (for throughput-intensive tasks), latency (for interactive applications requiring quick first responses), pricing (for cost-sensitive workloads), and API features like JSON mode or function calling.

Yes, provider performance can vary over time due to infrastructure changes, load balancing, and updates. We continuously benchmark all providers and display historical performance trends in the "Over Time" charts.

For information about gpt-oss-120B (high)'s intelligence, capabilities, modalities, and how it compares to other models, see the model overview page. View model overview