Cerebras Systems Inc. (NASDAQ:CBRS) unveiled a new AI system Tuesday that it says can generate answers up to 30 times faster than GPU-based alternatives, taking another shot at Nvidia Corp. (NASDAQ:NVDA) in the fast-growing market for AI inference.
The new CS-4 hit speeds of more than 4,400 tokens per second per user on GPT-OSS-120B in a company benchmark, roughly doubling the per-user speed of its predecessor. The first systems are expected to come online this quarter.
Same Silicon, More Speed
The CS-4 still uses the same underlying 5-nanometer WSE-3 silicon as its predecessor. SemiAnalysis says Cerebras roughly doubled clock speeds by increasing power delivery and improving cooling.
Cerebras also takes a different approach from Nvidia.
Instead of connecting thousands of GPUs, it builds a processor roughly the size of an entire silicon wafer, with 900,000 cores and fast on-chip memory.
That reduces the need to move data between separate chips, one reason Cerebras can deliver unusually fast inference.
Is 30X Believable?
The claim mainly applies to the kind of ultra-fast inference Cerebras is built for.
SemiAnalysis estimates CS-4 could reach about 4,000 tokens per second per user on frontier models, compared with roughly 100 to 200 for Nvidia’s Blackwell chips.
The performance jump comes partly from running the existing silicon much harder.
SemiAnalysis estimates a three-wafer CS-4 rack at roughly 125 to 135 kilowatts and says performance per watt improves only modestly over the previous generation.
Even so, The Register notes that is well below the 240 to 250 kilowatt racks Nvidia and AMD are preparing to ship later this year.
OpenAI Is Already Testing the Thesis
OpenAI is already putting that speed to work. The company last week previewed an Ultrafast tier powered by Cerebras that runs its flagship GPT-5.6 Sol model at up to 750 output tokens per second, up to 14 times faster than standard processing.
Cerebras is betting that faster inference can win customers from traditional GPU-based systems.
Prediction markets suggest demand for Nvidia compute could remain firm. Kalshi traders put a 64% chance on H200 rental prices ending the year above $6.69 an hour and a 61% chance on H100 prices staying above $3.38.
The launch comes during a rough stretch for AI stocks. Cerebras shares fell 12.7% Tuesday, erasing Monday’s 15% rally, as surging bond yields pressured high-growth technology stocks.
Image: Shutterstock
Kalshi and Benzinga have an existing data collaboration agreement.
Login to comment