Dispatches / a short note
LLM tokens speed simulator
LLM tok/s can cross 10k+ in near future, so just imagine
Looking forward to the day when Cerebras x OpenAI happens. Can’t wait to use agents at a wallet draining speed of ~1000tok/s…
LLM token visualiser (speed): https://mikeveerman.github.io/tokenspeed