Log inSign up free
Benchmarks › DeepSeek › DeepSeek
DeepSeekopen weightsRetired

DeepSeek V3

Released
Dec 26, 2024
Price in / out
$0.27 / $1.1
Blended $/1M
$0.478
Context
128K
Parameters: 671B / 37B active. License: MIT.

Benchmark scores

BenchmarkScoreRank (current)Source
SWE-bench Verified
42%#9 of 9benchlm.ai ↗
τ²-bench (Telecom)
22.8%#10 of 10benchlm.ai ↗
MMLU-Pro
75.9%#4 of 4benchlm.ai ↗
Artificial Analysis Intelligence Index
14.2#11 of 11benchlm.ai ↗

DeepSeek versions

Timeline
Version$ in / outTerminal-BenchSWE-benchGPQAHLEARC-AGI-2τ²-bench
DeepSeek V3Retired$0.27 / $1.1—42%———22.8%
DeepSeek R1Superseded$0.55 / $2.19—49.2%———36.5%
DeepSeek V3.1Superseded$0.56 / $1.68—66%———34.8%
DeepSeek V3.2Superseded$0.28 / $0.42—————78.9%
DeepSeek V4 FlashSuperseded$0.14 / $0.2867%79%88.1%34.8%61.4%—
DeepSeek V4 Pro$0.435 / $0.8754.7%80.6%90.1%42.7%61.3%96.2%
DeepSeek V4.1 Flash$0.14 / $0.2874.5%—90.9%36.8%——