Model
Context
Max Output
Latency
Throughput
Input
Output
Cache
Image Gen
Web Search
Capabilities
Providers
256K32K
2.2s
73tps
$0.03/M$1.20/M
Read:$0.06/M
Write:
novita logo
streamlake logo
1000K64K
0.8s
72tps
$3.00/M$15.00/M
Read:$0.30/M
Write:$3.75/M
$10.00/K
+ input costs
anthropic logo
bedrock logo
vertexAnthropic logo
1000K65K
0.8s
160tps
$0.50/M$3.00/M
Read:$0.05/M
Write:
$14.00/K
+ input costs
google logo
vertex logo
262K262K
0.3s
113tps
$0.50/M$2.80/M
Read:$0.10/M
Write:
bedrock logo
fireworks logo
moonshotai logo
+2
205K200K
0.4s
160tps
$0.28/M$1.20/M
Read:$0.03/M
Write:$0.38/M
bedrock logo
deepinfra logo
fireworks logo
+2
1049K66K
0.3s
112tps
$0.10/M$0.40/M
Read:$0.01/M
Write:
$35.00/K
+ input costs
google logo
vertex logo
200K64K
0.4s
115tps
$1.00/M$5.00/M
Read:$0.10/M
Write:$1.25/M
$10.00/K
+ input costs
anthropic logo
bedrock logo
vertexAnthropic logo
400K128K
1.0s
60tps
$1.75/M$14.00/M
Read:$0.17/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
200K64K
0.5s
54tps
$3.00/M$15.00/M
Read:$0.30/M
Write:$3.75/M
anthropic logo
bedrock logo
vertexAnthropic logo
1000K128K
2.1s
88tps
$5.00/M$25.00/M
Read:$0.50/M
Write:$6.25/M
$10/K
+ input costs
anthropic logo
bedrock logo
vertexAnthropic logo
1000K64K
0.8s
63tps
$3.00/M$15.00/M
Read:$0.30/M
Write:$3.75/M
$10.00/K
+ input costs
anthropic logo
bedrock logo
vertexAnthropic logo
200K64K
1.0s
60tps
$5.00/M$25.00/M
Read:$0.50/M
Write:$6.25/M
anthropic logo
bedrock logo
vertexAnthropic logo
128K16K
0.5s
121tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$10.00/M
$10.00/K
+ input costs
+1
openai logo
1000K64K
3.3s
121tps
$2.00/M$12.00/M
Read:$0.20/M
Write:
$14.00/K
+ input costs
google logo
vertex logo
256K256K
1.5s
240tps
$0.20/M$1.50/M
Read:$0.02/M
Write:
xai logo
205K131K
0.2s
459tps
$0.43/M$1.75/M
Read:$0.08/M
Write:
cerebras logo
deepinfra logo
novita logo
+1
400K128K
0.6s
$1.75/M$14.00/M
Read:$0.17/M
Write:
$10/K
+ input costs
openai logo
400K128K
6.6s
254tps
$0.05/M$0.40/M
Read:$0.01/M
Write:
$0.40/M
$10.00/K
+ input costs
azure logo
openai logo
1000K66K
0.4s
353tps
$0.30/M$2.50/M
Read:$0.03/M
Write:
$35.00/K
+ input costs
deepinfra logo
google logo
vertex logo
400K128K
4.4s
340tps
$0.25/M$2.00/M
Read:$0.03/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
164K66K
1.2s
42tps
$0.27/M$0.40/M
Read:$0.03/M
Write:
deepinfra logo
deepseek logo
novita logo
1049K66K
2.0s
118tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$35.00/K
+ input costs
deepinfra logo
google logo
vertex logo
128K16K
0.6s
107tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
2000K30K
0.8s
101tps
$0.20/M$0.50/M
Read:$0.05/M
Write:
xai logo
400K128K
5.0s
105tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$10.00/M
$10.00/K
+ input costs
azure logo
openai logo
128K16K
0.4s
59tps
$0.15/M$0.60/M
Read:$0.07/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
2000K30K
4.1s
227tps
$0.20/M$0.50/M
Read:$0.05/M
Write:
xai logo
131K131K
0.1s
977tps
$0.10/M$0.50/M
Read:$0.08/M
Write:
baseten logo
bedrock logo
cerebras logo
+5
400K128K
0.7s
33tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$10.00/M
$10.00/K
+ input costs
+1
azure logo
openai logo
256K256K
13.0s
68tps
mistral logo
2000K256K
0.7s
140tps
$0.20/M$0.50/M
Read:$0.05/M
Write:
xai logo
$0.02/M
azure logo
openai logo
33K66K
0.4s
202tps
$0.30/M$2.50/M$0.04/img
google logo
vertex logo
131K66K
0.1s
$0.07/M$0.30/M
Read:$0.04/M
Write:
groq logo
1048K33K
0.6s
111tps
$0.40/M$1.60/M
Read:$0.10/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
128K16K
0.5s
117tps
$2.50/M$10.00/M
Read:$1.25/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
2000K256K
3.1s
311tps
$0.20/M$0.50/M
Read:$0.05/M
Write:
xai logo
205K203K
0.3s
148tps
$0.45/M$1.80/M
Read:$0.11/M
Write:
baseten logo
deepinfra logo
fireworks logo
+2
1049K8K
0.3s
143tps
$0.07/M$0.30/M
$35.00/K
+ input costs
google logo
vertex logo
131K128K
0.2s
304tps
$0.07/M$0.30/M
bedrock logo
fireworks logo
groq logo
262K128K
0.3s
226tps
$0.60/M$2.50/M
baseten logo
fireworks logo
groq logo
+1
1048K33K
0.8s
41tps
$2.00/M$8.00/M
Read:$0.50/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
400K128K
0.6s
$1.25/M$10.00/M
Read:$0.13/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
1049K8K
0.4s
146tps
$0.10/M$0.40/M
Read:$0.03/M
Write:
$35.00/K
+ input costs
google logo
vertex logo
$0.10/M
mistral logo
128K4K
0.5s
192tps
$0.04/M$0.04/M
mistral logo
400K128K
0.5s
167tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
400K128K
0.7s
144tps
$0.25/M$2.00/M
Read:$0.03/M
Write:
$10.00/K
+ input costs
openai logo
128K8K
0.2s
$0.04/M$0.14/M
bedrock logo
164K164K
0.8s
36tps
$0.27/M$0.40/M
deepinfra logo
novita logo
$0.03/M
vertex logo
128K64K
1.5s
49tps
$0.28/M$0.42/M
Read:$0.03/M
Write:
deepseek logo
1048K33K
0.4s
$0.10/M$0.40/M
Read:$0.03/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
66K33K
12.9s
244tps
$2.00/M$120.00/M$120.00/M
$14.00/K
+ input costs
google logo
vertex logo
205K131K
1.3s
86tps
$0.30/M$2.40/M
Read:$0.03/M
Write:$0.38/M
minimax logo
131K131K
1.9s
31tps
$0.25/M$1.00/M
arcee-ai logo
$0.13/M
azure logo
openai logo
1049K66K
0.2s
415tps
$0.10/M$0.40/M
Read:$0.01/M
Write:
$35.00/K
+ input costs
google logo
vertex logo
$0.15/M
google logo
vertex logo
400K128K
2.5s
645tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$10.00/K
+ input costs
openai logo
200K131K
2.6s
55tps
zai logo
200K8K
0.6s
66tps
$3.00/M$15.00/M
Read:$0.30/M
Write:$3.75/M
bedrock logo
vertexAnthropic logo
164K164K
0.6s
101tps
$0.28/M$0.77/M
baseten logo
novita logo
1000K66K
0.3s
212tps
$0.30/M$2.50/M
Read:$0.03/M
Write:
$35.00/K
+ input costs
google logo
vertex logo
164K16K
0.6s
101tps
$0.50/M$2.15/M
Read:$0.40/M
Write:
bedrock logo
deepinfra logo
parasail logo
200K8K
0.5s
53tps
$0.80/M$4.00/M
Read:$0.08/M
Write:$1.00/M
anthropic logo
bedrock logo
vertexAnthropic logo
200K100K
2.1s
361tps
$1.10/M$4.40/M
Read:$0.28/M
Write:
azure logo
openai logo
131K33K
1.6s
54tps
$0.07/M$0.46/M
Read:$0.11/M
Write:
deepinfra logo
fireworks logo
novita logo
262K66K
0.9s
33tps
$0.84/M$3.38/M
Read:$0.24/M
Write:
alibaba logo
novita logo
131K131K
0.2s
80tps
$0.02/M$0.05/M
bedrock logo
cerebras logo
deepinfra logo
+2
200K32K
1.0s
46tps
$15.00/M$75.00/M
Read:$1.50/M
Write:$18.75/M
$10.00/K
+ input costs
anthropic logo
bedrock logo
vertexAnthropic logo
82K16K
0.3s
$0.80/M$1.20/M
morph logo
205K205K
0.8s
93tps
$0.30/M$1.20/M
Read:$0.03/M
Write:$0.38/M
minimax logo
novita logo
200K32K
1.1s
44tps
$15.00/M$75.00/M
Read:$1.50/M
Write:$18.75/M
$10.00/K
+ input costs
anthropic logo
bedrock logo
vertexAnthropic logo
262K32K
1.1s
158tps
$0.09/M$0.29/M
Read:$0.02/M
Write:
chutes logo
novita logo
128K16K
0.5s
75tps
$1.75/M$14.00/M
Read:$0.17/M
Write:
$10.00/K
+ input costs
openai logo
$0.18/M
voyage logo
200K100K
3.7s
66tps
$2.00/M$8.00/M
Read:$0.50/M
Write:
openai logo
131K8K
0.2s
421tps
$0.08/M$0.30/M
bedrock logo
deepinfra logo
groq logo
127K8K
1.6s
116tps
$1.00/M$1.00/M
perplexity logo
131K131K
0.6s
54tps
$0.50/M$2.00/M
deepinfra logo
fireworks logo
moonshotai logo
+2
256K16K
0.8s
$2.40/M$10.00/M
moonshotai logo
131K131K
0.3s
79tps
$0.02/M$0.04/M
deepinfra logo
mistral logo
novita logo
300K8K
0.4s
$0.06/M$0.24/M
bedrock logo
256K256K
4.2s
72tps
$3.00/M$15.00/M
xai logo
1000K66K
1.8s
56tps
$1.00/M$5.00/M
Read:$0.20/M
Write:
alibaba logo
128K33K
0.2s
158tps
$0.59/M$0.72/M
Read:$0.85/M
Write:
bedrock logo
cerebras logo
groq logo
256K256K
0.3s
mistral logo
262K67K
0.3s
90tps
$0.40/M$1.60/M
Read:$0.30/M
Write:
alibaba logo
deepinfra logo
fireworks logo
+1
200K100K
2.0s
$15.00/M$60.00/M
Read:$7.50/M
Write:
azure logo
openai logo
$0.15/M
mistral logo
262K262K
0.4s
53tps
$0.30/M$2.90/M
deepinfra logo
novita logo
200K8K
1.7s
147tps
$3.00/M$15.00/M
perplexity logo
256K256K
1.2s
48tps
$0.50/M$1.50/M
mistral logo
200K100K
2.3s
$1.10/M$4.40/M
Read:$0.55/M
Write:
azure logo
openai logo
262K262K
0.3s
184tps
$0.47/M$2.00/M
Read:$0.14/M
Write:
baseten logo
deepinfra logo
fireworks logo
+2
164K164K
0.2s
253tps
$0.30/M$1.00/M
baseten logo
deepinfra logo
fireworks logo
+3
131K16K
0.4s
32tps
$0.40/M$0.40/M
bedrock logo
deepinfra logo
524K8K
0.2s
49tps
$0.15/M$0.60/M
bedrock logo
deepinfra logo
vertex logo
131K41K
0.2s
302tps
$0.10/M$0.30/M
alibaba logo
bedrock logo
cerebras logo
+2
131K66K
1.9s
44tps
$0.27/M$1.00/M
novita logo
400K128K
16.7s
$21.00/M$168.00/M
$10.00/K
+ input costs
openai logo
200K128K
1.9s
78tps
$0.06/M$0.40/M
Read:$0.01/M
Write:
zai logo
262K66K
0.4s
172tps
$0.09/M$1.10/M
alibaba logo
deepinfra logo
novita logo
262K33K
0.4s
75tps
$0.07/M$0.27/M
bedrock logo
novita logo
1000K1000K
0.4s
184tps
$0.30/M$2.50/M
bedrock logo
262K262K
0.7s
119tps
$1.15/M$8.00/M
Read:$0.15/M
Write:
moonshotai logo
200K4K
0.3s
148tps
$0.25/M$1.25/M
Read:$0.03/M
Write:$0.30/M
anthropic logo
bedrock logo
vertexAnthropic logo
128K100K
3.8s
129tps
chutes logo
meituan logo
32K4K
0.3s
107tps
$0.10/M$0.30/M
mistral logo
$0.03/M
vertex logo
33K33K
0.4s
194tps
$0.30/M$2.50/M$0.04/img
google logo
128K24K
2.1s
147tps
zai logo
128K4K
0.2s
101tps
$0.10/M$0.10/M
mistral logo
131K131K
0.3s
136tps
$0.20/M$0.60/M
bedrock logo
deepinfra logo
131K131K
3.3s
312tps
$0.30/M$0.50/M
xai logo
131K131K
3.5s
297tps
$0.60/M$4.00/M
xai logo
131K131K
0.3s
73tps
$3.00/M$15.00/M
xai logo
$0.10/M
azure logo
openai logo
128K4K
0.2s
$0.30/M$0.90/M
mistral logo
128K24K
2.0s
111tps
$0.30/M$0.90/M
Read:$0.05/M
Write:
zai logo
200K8K
0.5s
82tps
$3.00/M$15.00/M
Read:$0.30/M
Write:$3.75/M
bedrock logo
vertexAnthropic logo
16K4K
0.4s
$0.50/M$1.50/M
openai logo
256K256K
0.3s
153tps
$0.20/M$0.20/M
mistral logo
131K131K
0.4s
116tps
$0.20/M$1.10/M
parasail logo
256K256K
0.7s
89tps
$0.22/M$0.88/M
alibaba logo
fireworks logo
novita logo
131K66K
0.9s
306tps
$0.15/M$1.50/M
alibaba logo
novita logo
33K33K
0.6s
102tps
$2.00/M$10.00/M
xai logo
128K8K
0.3s
54tps
$0.15/M$0.15/M
bedrock logo
400K272K
$15.00/M$120.00/M$120.00/M
$10.00/K
+ input costs
+1
openai logo
131K131K
0.2s
151tps
$0.04/M$0.16/M
bedrock logo
deepinfra logo
262K262K
0.2s
62tps
$0.20/M$0.88/M
Read:$0.11/M
Write:
alibaba logo
deepinfra logo
fireworks logo
+1
41K16K
0.2s
68tps
$0.06/M$0.24/M
deepinfra logo
128K64K
0.3s
$0.10/M$0.30/M
mistral logo
131K131K
1.7s
64tps
$0.60/M$2.20/M
Read:$0.11/M
Write:
novita logo
zai logo
33K33K
3.8s
97tps
meituan logo
128K32K
5.5s
55tps
$3.00/M$15.00/M
vercel logo
256K66K
1.7s
31tps
$1.20/M$6.00/M
Read:$0.24/M
Write:
alibaba logo
256K64K
1.1s
88tps
$0.25/M$2.00/M
Read:$0.05/M
Write:
bytedance logo
128K33K
5.0s
58tps
$3.00/M$15.00/M
vercel logo
128K4K
0.3s
70tps
$2.00/M$6.00/M
mistral logo
127K8K
1.6s
107tps
$2.00/M$8.00/M
perplexity logo
128K96K
2.0s
99tps
$0.20/M$1.10/M
Read:$0.03/M
Write:
zai logo
128K4K
0.3s
147tps
$0.15/M$0.15/M
mistral logo
41K16K
0.2s
35tps
$0.08/M$0.29/M
deepinfra logo
256K32K
1.6s
56tps
$0.25/M$2.00/M
Read:$0.05/M
Write:
bytedance logo
128K4K
0.8s
17tps
$10.00/M$30.00/M
openai logo
128K16K
1.6s
107tps
$0.15/M$0.60/M
$10.00/K
+ input costs
openai logo
128K64K
0.3s
120tps
$0.40/M$2.00/M
mistral logo
262K262K
0.2s
$0.06/M$0.24/M
deepinfra logo
300K8K
0.4s
104tps
$0.80/M$3.20/M
bedrock logo
66K16K
0.4s
77tps
$0.60/M$1.80/M
Read:$0.11/M
Write:
novita logo
zai logo
131K131K
0.3s
67tps
$5.00/M$25.00/M
xai logo
131K131K
0.5s
208tps
$0.04/M$0.15/M
arcee-ai logo
256K256K
0.4s
139tps
$0.50/M$1.20/M
togetherai logo
256K8K
0.4s
63tps
$2.50/M$10.00/M
cohere logo
200K100K
2.1s
217tps
$1.50/M$6.00/M
Read:$0.38/M
Write:
openai logo
$0.18/M
voyage logo
200K100K
28.4s
$20.00/M$80.00/M
openai logo
200K8K
0.7s
23tps
$15.00/M$75.00/M
bedrock logo
128K64K
0.4s
37tps
$2.00/M$5.00/M
mistral logo
128K64K
0.3s
148tps
$0.50/M$1.50/M
mistral logo
33K33K
$0.05/M
deepinfra logo
128K8K
0.2s
47tps
$0.16/M$0.16/M
bedrock logo
128K8K
0.2s
86tps
$0.10/M$0.10/M
bedrock logo
262K33K
1.7s
71tps
$1.20/M$6.00/M
Read:$0.24/M
Write:
alibaba logo
128K8K
0.3s
63tps
$0.72/M$0.72/M
bedrock logo
33K33K
$0.01/M
deepinfra logo
82K16K
0.4s
49tps
$0.90/M$1.90/M
morph logo
66K2K
0.3s
$1.20/M$1.20/M
fireworks logo
$0.12/M
cohere logo
$0.06/M
voyage logo
$0.02/M
bedrock logo
32K16K
0.5s
$0.25/M$1.00/M
inception logo
33K33K
$0.02/M
deepinfra logo
$0.02/M
voyage logo
$0.12/M
voyage logo
8K4K
$1.50/M$2.00/M
openai logo
480
$0.04/img
vertex logo
480
$0.06/img
vertex logo
$0.015/MP
bfl logo
$0.04/img
recraft logo
$0.06/MP
bfl logo
67K67K
$0.03/MP
bfl logo
$0.05/img
bfl logo
512
$0.08/img
bfl logo
480
$0.02/img
vertex logo
128K8K
$0.15/M$1.50/M
chutes logo
512
$0.04/img
bfl logo
prodia logo
$0.06/img
bfl logo
$0.12/M
voyage logo
67K67K
$0.07/MP
bfl logo
200K100K
$10.00/M$40.00/M
Read:$2.50/M
Write:
$10.00/K
+ input costs
openai logo
127K8K
$1.00/M$5.00/M
perplexity logo
$0.02/img
recraft logo
$0.04/img
bfl logo
$0.014/MP
bfl logo
$0.12/M
voyage logo