DeepSeek · Nerf Watch

DeepSeek V4 Pro

All models · Nerf Watch

Latest Nerf Watch result

On 2026-10-28, DeepSeek V4 Pro scored 91.18 on Nerf Watch's suite 2026.10.1; its 7-day baseline is not yet available.

Latest run
91.18 on · suite 2026.10.1
Previous run
97.06 on · suite 2026.10.1
Change from previous run
−5.88
7-day baseline
-- · 2 baseline runs
Change from baseline
--
Trend
--

A score below the model's own baseline, the mean of its recent runs. One day's dip can be noise, and a lower score is a lower score on this suite, not proof that a provider changed a model.

Data: tokenusage.dev · Read the Nerf Watch method

Score history

2026-07-31 to 2026-10-28, UTC
8090100Jul 31Oct 28
As a table
DeepSeek V4 Pro score history
Day, UTCScoreSuite
91.182026.10.1
97.062026.10.1
100.002026.10.1

Speed

Response time

On , DeepSeek V4 Pro's daily response-time probe recorded a median completion time of 3 s across three successful responses at high reasoning effort and Standard/default service.

The daily local probe is scheduled at 00:10 UTC. It uses high reasoning effort and three successful fresh single-turn responses to one fixed small task. A day without three successful responses has no point. Lower is faster; dates are UTC.

Drag across the chart to zoom in.Pinch to zoom; drag with two fingers to move.

01s2s3sOct 15Oct 28

Output speed

On , DeepSeek V4 Pro's Nerf Watch run recorded 65 output tokens per second.

Tokens per second from the daily Nerf Watch run, scheduled at 01:00 UTC: total output tokens divided by total completion time across its four fixed tasks. Effort is low, except DeepSeek V4 Pro uses high, its lowest available variant. Service is Standard/default, or Ultrafast for the two Ultrafast lines. Output includes reported reasoning or thinking tokens once; OpenCode’s separately reported reasoning is added to output. Timing includes waiting within the measured turn and excludes setup and process exit. Higher is faster; dates are UTC.

Drag across the chart to zoom in.Pinch to zoom; drag with two fingers to move.

0255075100Oct 15Oct 28

Facts from the research notes

API price

No exact-model record in these research notes.

Context window

Published context window recorded in Research note 003, as of 2026-10-13: 1M; config 1,048,576. Record dated 2026-04-24. Served · API and open weights. Lab headline retained; maximum output 384K.

V4 announcement · Research note 003

Parameters

Disclosed parameters recorded in Research note 004, as of 2026-10-12: 1.6T total; 49B active per token. MoE; high confidence; preview and open weights; general availability 2026-08-13.

Announcement · Research note 004