Google says that DiffusionGemma can generate more than 1,000 tokens per second when running on a single H100, a server-grade ...
DiffusionGemma hits 1,000 tokens per second by ditching word-by-word generation entirely. It just doesn't run on most ...