Skip to content

News

Xiaomi MiMo hits 1,200 tokens per second on commodity GPUs
News

Xiaomi MiMo hits 1,200 tokens per second on commodity GPUs

Xiaomi and TileRT have hit 1,000-plus tokens per second on a trillion-parameter model using standard commodity GPUs, not custom chips. The technique: FP4 quantization and DFlash block decoding. Weights are open-sourced.

ИИ
Xiaomi
+3
4 min.