DeepSeek-V4.1-Flash (552B) on a single 4090

The 27 tokens per second decode figure hides the real bottleneck. Prefill runs at 180 to 320 tokens per second, so an agentic task carrying a 100K-token context waits roughly 5 to 9 minutes before the first output token. The setup also needs 90GB of system RAM plus streaming experts from NVMe. It is a clever single-user demo, not a way for a team to serve agent workloads, and paying DeepSeek's own API per task stays cheaper and faster for builders.

Read the coverage (r/LocalLLaMA)

A view on what the development means for people building products. Not a view on any company's stock and not investment advice.

Every Not this Today's brief