Model
Context
Max Output
Latency
Throughput
Input
Output
Cache
Image Gen
Web Search
Capabilities
Providers
256K32K
2.0s
61tps
$0.03/M$1.20/M
Read:$0.06/M
Write:
novita logo
streamlake logo
1000K64K
0.8s
70tps
$3.00/M$15.00/M
Read:$0.30/M
Write:$3.75/M
$10.00/K
+ input costs
anthropic logo
bedrock logo
vertexAnthropic logo
1000K65K
0.7s
177tps
$0.50/M$3.00/M
Read:$0.05/M
Write:
$14.00/K
+ input costs
google logo
vertex logo
262K262K
0.6s
129tps
$0.50/M$2.80/M
Read:$0.10/M
Write:
bedrock logo
fireworks logo
moonshotai logo
+2
205K200K
0.5s
192tps
$0.28/M$1.20/M
Read:$0.03/M
Write:$0.38/M
bedrock logo
deepinfra logo
fireworks logo
+2
1049K66K
0.3s
238tps
$0.10/M$0.40/M
Read:$0.01/M
Write:
$35.00/K
+ input costs
google logo
vertex logo
200K64K
0.7s
113tps
$1.00/M$5.00/M
Read:$0.10/M
Write:$1.25/M
$10.00/K
+ input costs
anthropic logo
bedrock logo
vertexAnthropic logo
400K128K
1.0s
56tps
$1.75/M$14.00/M
Read:$0.17/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
200K64K
0.4s
65tps
$3.00/M$15.00/M
Read:$0.30/M
Write:$3.75/M
anthropic logo
bedrock logo
vertexAnthropic logo
1000K128K
2.3s
78tps
$5.00/M$25.00/M
Read:$0.50/M
Write:$6.25/M
$10/K
+ input costs
anthropic logo
bedrock logo
vertexAnthropic logo
1000K64K
0.9s
67tps
$3.00/M$15.00/M
Read:$0.30/M
Write:$3.75/M
$10.00/K
+ input costs
anthropic logo
bedrock logo
vertexAnthropic logo
200K64K
0.8s
55tps
$5.00/M$25.00/M
Read:$0.50/M
Write:$6.25/M
anthropic logo
bedrock logo
vertexAnthropic logo
128K16K
0.5s
118tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$10.00/M
$10.00/K
+ input costs
+1
openai logo
1000K64K
3.8s
126tps
$2.00/M$12.00/M
Read:$0.20/M
Write:
$14.00/K
+ input costs
google logo
vertex logo
256K256K
1.6s
269tps
$0.20/M$1.50/M
Read:$0.02/M
Write:
xai logo
205K131K
1.9s
428tps
$0.43/M$1.75/M
Read:$0.08/M
Write:
cerebras logo
deepinfra logo
novita logo
+1
400K128K
4.8s
236tps
$0.05/M$0.40/M
Read:$0.01/M
Write:
$0.40/M
$10.00/K
+ input costs
azure logo
openai logo
400K128K
1.0s
76tps
$1.75/M$14.00/M
Read:$0.17/M
Write:
$10/K
+ input costs
openai logo
1000K66K
0.3s
324tps
$0.30/M$2.50/M
Read:$0.03/M
Write:
$35.00/K
+ input costs
deepinfra logo
google logo
vertex logo
400K128K
4.2s
268tps
$0.25/M$2.00/M
Read:$0.03/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
164K66K
1.0s
43tps
$0.27/M$0.40/M
Read:$0.03/M
Write:
deepinfra logo
deepseek logo
novita logo
1049K66K
2.2s
182tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$35.00/K
+ input costs
deepinfra logo
google logo
vertex logo
2000K30K
0.9s
103tps
$0.20/M$0.50/M
Read:$0.05/M
Write:
xai logo
128K16K
0.6s
99tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
400K128K
4.7s
554tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$10.00/M
$10.00/K
+ input costs
azure logo
openai logo
2000K30K
4.7s
186tps
$0.20/M$0.50/M
Read:$0.05/M
Write:
xai logo
128K16K
0.6s
126tps
$0.15/M$0.60/M
Read:$0.07/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
131K131K
0.1s
1280tps
$0.10/M$0.50/M
Read:$0.08/M
Write:
baseten logo
bedrock logo
cerebras logo
+5
400K128K
0.7s
103tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$10.00/M
$10.00/K
+ input costs
+1
azure logo
openai logo
256K256K
4.6s
66tps
mistral logo
2000K256K
0.7s
124tps
$0.20/M$0.50/M
Read:$0.05/M
Write:
xai logo
$0.02/M
azure logo
openai logo
33K66K
0.3s
188tps
$0.30/M$2.50/M$0.04/img
google logo
vertex logo
131K66K
0.1s
$0.07/M$0.30/M
Read:$0.04/M
Write:
groq logo
1048K33K
0.7s
73tps
$0.40/M$1.60/M
Read:$0.10/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
128K16K
0.6s
78tps
$2.50/M$10.00/M
Read:$1.25/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
2000K256K
2.5s
205tps
$0.20/M$0.50/M
Read:$0.05/M
Write:
xai logo
205K203K
0.4s
133tps
$0.45/M$1.80/M
Read:$0.11/M
Write:
baseten logo
deepinfra logo
fireworks logo
+2
131K128K
0.1s
319tps
$0.07/M$0.30/M
bedrock logo
fireworks logo
groq logo
1049K8K
0.3s
151tps
$0.07/M$0.30/M
$35.00/K
+ input costs
google logo
vertex logo
262K128K
0.2s
85tps
$0.60/M$2.50/M
baseten logo
fireworks logo
groq logo
+1
1048K33K
0.7s
39tps
$2.00/M$8.00/M
Read:$0.50/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
400K128K
0.6s
116tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
1049K8K
0.3s
158tps
$0.10/M$0.40/M
Read:$0.03/M
Write:
$35.00/K
+ input costs
google logo
vertex logo
$0.10/M
mistral logo
128K4K
0.6s
300tps
$0.04/M$0.04/M
mistral logo
400K128K
0.5s
162tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
400K128K
0.5s
$0.25/M$2.00/M
Read:$0.03/M
Write:
$10.00/K
+ input costs
openai logo
128K8K
0.3s
$0.04/M$0.14/M
bedrock logo
164K164K
0.8s
36tps
$0.27/M$0.40/M
deepinfra logo
novita logo
$0.03/M
vertex logo
128K64K
1.5s
41tps
$0.28/M$0.42/M
Read:$0.03/M
Write:
deepseek logo
1048K33K
0.4s
48tps
$0.10/M$0.40/M
Read:$0.03/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
66K33K
13.0s
210tps
$2.00/M$120.00/M$120.00/M
$14.00/K
+ input costs
google logo
vertex logo
1049K66K
0.3s
368tps
$0.10/M$0.40/M
Read:$0.01/M
Write:
$35.00/K
+ input costs
google logo
vertex logo
$0.15/M
google logo
vertex logo
131K131K
1.3s
29tps
$0.25/M$1.00/M
arcee-ai logo
205K131K
2.3s
82tps
$0.30/M$2.40/M
Read:$0.03/M
Write:$0.38/M
minimax logo
400K128K
2.5s
253tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$10.00/K
+ input costs
openai logo
200K131K
3.1s
45tps
zai logo
200K8K
0.6s
65tps
$3.00/M$15.00/M
Read:$0.30/M
Write:$3.75/M
bedrock logo
vertexAnthropic logo
1000K66K
0.3s
208tps
$0.30/M$2.50/M
Read:$0.03/M
Write:
$35.00/K
+ input costs
google logo
vertex logo
164K164K
0.7s
37tps
$0.28/M$0.77/M
baseten logo
novita logo
164K16K
0.3s
168tps
$0.50/M$2.15/M
Read:$0.40/M
Write:
bedrock logo
deepinfra logo
parasail logo
200K100K
1.7s
228tps
$1.10/M$4.40/M
Read:$0.28/M
Write:
azure logo
openai logo
$0.13/M
azure logo
openai logo
131K33K
0.9s
72tps
$0.07/M$0.46/M
Read:$0.11/M
Write:
deepinfra logo
fireworks logo
novita logo
262K66K
1.6s
33tps
$0.84/M$3.38/M
Read:$0.24/M
Write:
alibaba logo
novita logo
200K8K
0.5s
53tps
$0.80/M$4.00/M
Read:$0.08/M
Write:$1.00/M
anthropic logo
bedrock logo
vertexAnthropic logo
131K131K
0.2s
74tps
$0.02/M$0.05/M
bedrock logo
cerebras logo
deepinfra logo
+2
200K32K
1.1s
42tps
$15.00/M$75.00/M
Read:$1.50/M
Write:$18.75/M
$10.00/K
+ input costs
anthropic logo
bedrock logo
vertexAnthropic logo
205K205K
0.9s
76tps
$0.30/M$1.20/M
Read:$0.03/M
Write:$0.38/M
minimax logo
novita logo
82K16K
0.3s
$0.80/M$1.20/M
morph logo
200K32K
1.2s
47tps
$15.00/M$75.00/M
Read:$1.50/M
Write:$18.75/M
$10.00/K
+ input costs
anthropic logo
bedrock logo
vertexAnthropic logo
131K8K
0.1s
159tps
$0.08/M$0.30/M
bedrock logo
deepinfra logo
groq logo
128K16K
1.2s
82tps
$1.75/M$14.00/M
Read:$0.17/M
Write:
$10.00/K
+ input costs
openai logo
$0.18/M
voyage logo
262K32K
2.4s
148tps
$0.09/M$0.29/M
Read:$0.02/M
Write:
chutes logo
novita logo
200K100K
3.7s
98tps
$2.00/M$8.00/M
Read:$0.50/M
Write:
openai logo
127K8K
1.5s
117tps
$1.00/M$1.00/M
perplexity logo
131K131K
0.6s
57tps
$0.50/M$2.00/M
deepinfra logo
fireworks logo
moonshotai logo
+2
131K131K
0.2s
78tps
$0.02/M$0.04/M
deepinfra logo
mistral logo
novita logo
256K16K
0.9s
75tps
$2.40/M$10.00/M
moonshotai logo
256K256K
3.8s
70tps
$3.00/M$15.00/M
xai logo
128K33K
0.2s
452tps
$0.59/M$0.72/M
Read:$0.85/M
Write:
bedrock logo
cerebras logo
groq logo
200K100K
2.4s
$15.00/M$60.00/M
Read:$7.50/M
Write:
azure logo
openai logo
300K8K
0.4s
100tps
$0.06/M$0.24/M
bedrock logo
1000K66K
1.5s
48tps
$1.00/M$5.00/M
Read:$0.20/M
Write:
alibaba logo
256K256K
0.3s
180tps
mistral logo
262K67K
0.7s
113tps
$0.40/M$1.60/M
Read:$0.30/M
Write:
alibaba logo
deepinfra logo
fireworks logo
+1
$0.15/M
mistral logo
200K8K
1.3s
118tps
$3.00/M$15.00/M
perplexity logo
262K262K
0.4s
62tps
$0.30/M$2.90/M
deepinfra logo
novita logo
256K256K
0.6s
65tps
$0.50/M$1.50/M
mistral logo
200K100K
2.2s
$1.10/M$4.40/M
Read:$0.55/M
Write:
azure logo
openai logo
262K262K
0.4s
195tps
$0.47/M$2.00/M
Read:$0.14/M
Write:
baseten logo
deepinfra logo
fireworks logo
+2
164K164K
0.1s
267tps
$0.30/M$1.00/M
baseten logo
deepinfra logo
fireworks logo
+3
131K41K
0.1s
383tps
$0.10/M$0.30/M
alibaba logo
bedrock logo
cerebras logo
+2
131K16K
0.3s
32tps
$0.40/M$0.40/M
bedrock logo
deepinfra logo
524K8K
0.2s
56tps
$0.15/M$0.60/M
bedrock logo
deepinfra logo
vertex logo
131K66K
1.1s
37tps
$0.27/M$1.00/M
novita logo
400K128K
$21.00/M$168.00/M
$10.00/K
+ input costs
openai logo
262K33K
0.7s
178tps
$0.07/M$0.27/M
bedrock logo
novita logo
262K66K
0.3s
157tps
$0.09/M$1.10/M
alibaba logo
deepinfra logo
novita logo
200K128K
4.6s
51tps
$0.06/M$0.40/M
Read:$0.01/M
Write:
zai logo
262K262K
1.4s
106tps
$1.15/M$8.00/M
Read:$0.15/M
Write:
moonshotai logo
1000K1000K
0.5s
132tps
$0.30/M$2.50/M
bedrock logo
128K100K
3.5s
109tps
chutes logo
meituan logo
200K4K
0.3s
147tps
$0.25/M$1.25/M
Read:$0.03/M
Write:$0.30/M
anthropic logo
bedrock logo
vertexAnthropic logo
$0.03/M
vertex logo
32K4K
0.2s
101tps
$0.10/M$0.30/M
mistral logo
33K33K
0.4s
197tps
$0.30/M$2.50/M$0.04/img
google logo
128K24K
1.9s
133tps
zai logo
131K131K
0.3s
136tps
$0.20/M$0.60/M
bedrock logo
deepinfra logo
131K131K
4.0s
252tps
$0.30/M$0.50/M
xai logo
128K4K
0.2s
68tps
$0.10/M$0.10/M
mistral logo
131K131K
3.7s
309tps
$0.60/M$4.00/M
xai logo
200K8K
0.5s
83tps
$3.00/M$15.00/M
Read:$0.30/M
Write:$3.75/M
bedrock logo
vertexAnthropic logo
128K24K
3.0s
99tps
$0.30/M$0.90/M
Read:$0.05/M
Write:
zai logo
$0.10/M
azure logo
openai logo
131K131K
0.8s
73tps
$3.00/M$15.00/M
xai logo
128K4K
0.3s
$0.30/M$0.90/M
mistral logo
16K4K
0.5s
$0.50/M$1.50/M
openai logo
256K256K
1.7s
108tps
$0.20/M$0.20/M
mistral logo
131K131K
0.3s
116tps
$0.20/M$1.10/M
parasail logo
256K256K
0.8s
91tps
$0.22/M$0.88/M
alibaba logo
fireworks logo
novita logo
131K66K
0.9s
332tps
$0.15/M$1.50/M
alibaba logo
novita logo
128K8K
0.3s
55tps
$0.15/M$0.15/M
bedrock logo
33K33K
0.6s
102tps
$2.00/M$10.00/M
xai logo
400K272K
$15.00/M$120.00/M$120.00/M
$10.00/K
+ input costs
+1
openai logo
262K262K
0.3s
59tps
$0.20/M$0.88/M
Read:$0.11/M
Write:
alibaba logo
deepinfra logo
fireworks logo
+1
131K131K
0.2s
149tps
$0.04/M$0.16/M
bedrock logo
deepinfra logo
128K64K
0.3s
$0.10/M$0.30/M
mistral logo
41K16K
0.2s
67tps
$0.06/M$0.24/M
deepinfra logo
131K131K
1.7s
81tps
$0.60/M$2.20/M
Read:$0.11/M
Write:
novita logo
zai logo
33K33K
3.8s
100tps
meituan logo
128K32K
4.4s
59tps
$3.00/M$15.00/M
vercel logo
256K64K
1.3s
79tps
$0.25/M$2.00/M
Read:$0.05/M
Write:
bytedance logo
256K66K
1.7s
31tps
$1.20/M$6.00/M
Read:$0.24/M
Write:
alibaba logo
128K4K
0.4s
72tps
$2.00/M$6.00/M
mistral logo
128K96K
2.2s
96tps
$0.20/M$1.10/M
Read:$0.03/M
Write:
zai logo
128K4K
0.3s
138tps
$0.15/M$0.15/M
mistral logo
41K16K
0.1s
42tps
$0.08/M$0.29/M
deepinfra logo
128K33K
5.0s
58tps
$3.00/M$15.00/M
vercel logo
127K8K
1.5s
109tps
$2.00/M$8.00/M
perplexity logo
128K4K
1.0s
28tps
$10.00/M$30.00/M
openai logo
256K32K
1.5s
60tps
$0.25/M$2.00/M
Read:$0.05/M
Write:
bytedance logo
128K16K
1.7s
$0.15/M$0.60/M
$10.00/K
+ input costs
openai logo
128K64K
0.3s
120tps
$0.40/M$2.00/M
mistral logo
262K262K
0.2s
$0.06/M$0.24/M
deepinfra logo
300K8K
0.4s
134tps
$0.80/M$3.20/M
bedrock logo
66K16K
0.7s
56tps
$0.60/M$1.80/M
Read:$0.11/M
Write:
novita logo
zai logo
131K131K
0.5s
70tps
$5.00/M$25.00/M
xai logo
131K131K
0.5s
222tps
$0.04/M$0.15/M
arcee-ai logo
256K256K
0.4s
73tps
$0.50/M$1.20/M
togetherai logo
256K8K
1.1s
57tps
$2.50/M$10.00/M
cohere logo
200K100K
1.6s
233tps
$1.50/M$6.00/M
Read:$0.38/M
Write:
openai logo
$0.18/M
voyage logo
200K100K
$20.00/M$80.00/M
openai logo
200K8K
0.7s
24tps
$15.00/M$75.00/M
bedrock logo
128K64K
0.4s
40tps
$2.00/M$5.00/M
mistral logo
128K64K
0.3s
95tps
$0.50/M$1.50/M
mistral logo
128K8K
0.2s
41tps
$0.16/M$0.16/M
bedrock logo
128K8K
0.2s
88tps
$0.10/M$0.10/M
bedrock logo
262K33K
1.7s
72tps
$1.20/M$6.00/M
Read:$0.24/M
Write:
alibaba logo
128K8K
0.3s
63tps
$0.72/M$0.72/M
bedrock logo
33K33K
$0.01/M
deepinfra logo
33K33K
$0.05/M
deepinfra logo
82K16K
0.3s
$0.90/M$1.90/M
morph logo
66K2K
0.2s
$1.20/M$1.20/M
fireworks logo
$0.12/M
cohere logo
$0.02/M
bedrock logo
$0.06/M
voyage logo
32K16K
0.4s
$0.25/M$1.00/M
inception logo
33K33K
$0.02/M
deepinfra logo
$0.02/M
voyage logo
$0.12/M
voyage logo
8K4K
$1.50/M$2.00/M
openai logo
480
$0.04/img
vertex logo
480
$0.06/img
vertex logo
$0.015/MP
bfl logo
$0.04/img
recraft logo
$0.06/MP
bfl logo
67K67K
$0.03/MP
bfl logo
$0.05/img
bfl logo
512
$0.08/img
bfl logo
480
$0.02/img
vertex logo
128K8K
$0.15/M$1.50/M
chutes logo
512
$0.04/img
bfl logo
prodia logo
$0.06/img
bfl logo
$0.12/M
voyage logo
67K67K
$0.07/MP
bfl logo
200K100K
$10.00/M$40.00/M
Read:$2.50/M
Write:
$10.00/K
+ input costs
openai logo
127K8K
$1.00/M$5.00/M
perplexity logo
$0.02/img
recraft logo
$0.04/img
bfl logo
$0.014/MP
bfl logo
$0.12/M
voyage logo