Skip to content
Dashboard

AI model leaderboards

See top models, labs, apps, and providers on AI Gateway with token, request, and cost trends.

DeepsecBench

DeepsecBench measures how well different AI models find security vulnerabilities in application code, based on the deepsec cyber harness(opens in new tab). The report combines recall and precision into a single benchmark score.

OpenAI
Anthropic
Moonshot AI
DeepSeek
Alibaba
xAI
Google
Z.ai
Thinking Machines

Score vs Cost

010203040$0$50$100$150Cost (USD)Score

Score vs Total Time

0102030400h1h2h3h4h5hTotal timeScore

Ranked results

1
35.58
30.7%96.3%71/2313$55.983h 39m2.3Mcodex
2
32.57
28.1%88.0%65/23110$127.932h 34m4.5Mclaude
3
28.36
24.7%70.5%57/23126$31.9647m 1s999.7Kclaude
4
26.79
22.9%81.2%53/23113$24.593h 1m3.3Mcodex
5
25.10
21.2%94.3%49/2313$17.9530m 52s703.0Kcodex
6
21.20
17.7%95.5%41/2312$43.422h 22m2.2Mcodex
7
19.21
16.0%95.3%37/2312$27.811h 45m2.1Mcodex
8
17.56
14.7%77.1%34/23111$12.381h 59m731.9Kpi
9
17.06
14.3%76.1%33/23111$45.173h 8m4.6Mclaude
10
16.54
13.9%74.0%32/23113$5.941h 18m1.5Mpi
11
16.54
13.9%73.9%32/23112$6.331h 52m342.6Kpi
12
16.54
13.9%73.3%32/23112$11.041h 37m909.6Kpi
13
16.23
13.4%100.0%31/2310$22.294h 2m3.5Mpi
14
15.59
13.0%78.9%30/2318$6.222h 3m383.4Kpi
15
15.58
13.0%77.8%30/23110$5.601h 24m1.0Mpi
16
15.48
13.0%66.7%30/23116$5.061h 21m1.4Mpi
17
12.63
10.4%92.3%24/2312$14.9424m 5s751.4Kcodex
18
12.12
10.0%92.0%23/2312$5.1513m 15s617.7Kcodex
19
12.08
10.0%82.8%23/2315$5.2311m 59s572.0Kcodex
20
11.56
9.5%80.0%22/2316$10.7426m 21s2.7Mpi
21
11.48
9.5%64.1%22/23114$10.841h 29m676.6Kpi
22
10.46
8.7%62.5%20/23112$11.091h 3m1.5Mpi
23
9.90
8.2%53.8%19/23118$51.842h 30m4.7Mpi
24
8.99
7.4%77.3%17/2315$5.3322m 18s1.8Mpi
25
6.91
5.6%81.3%13/2313$7.5619m 29s80.8Kclaude
26
6.88
5.6%61.9%13/2318$10.8118m 16s78.1Kclaude
27
6.32
5.2%48.0%12/23113$1.9311m 34s300.9Kpi
28
5.84
4.8%61.1%11/2317$6.6615m 47s442.2Kclaude
29
5.26
4.3%37.0%10/23117$2.1810m 31s509.0Kpi
30
4.73
3.9%33.3%9/23118$5.9129m 40s912.4Kclaude
31
2.14
1.7%44.4%4/2315$0.581m 46s459.9Kpi
32
1.07
0.9%28.6%2/2315$0.181m 7s406.5Kpi