There was a pretty funny anecdotal complaint from the Machine Learning $Reddit(RDDT.US) subreddit.On $Cerebras(CBRS.US) + OpenAI:- Needs 1-2K tokens/sec so tries to use Cerebras.- Claims OpenAI reserved all capacity, making waitlist infinite for everyone else not a hyperscaler.- Stated alternatives with Groq’s API not accessible to themFeels bad. But it does show how few players / limited capacity there is for fast inference.

Cerebras

Reddit

OpenAI

AI/Semi Supply Chain Analyst
ex. RISC-V FDN, AI research scientist;