MoE
Dual MI50, part 3: DeepSeek-V4.1-Flash (552B) on two 2018 GPUs
I tried three engines to run DeepSeek-V4.1-Flash, a 552-billion-parameter MoE, on two 16 GB AMD MI50s. Porting Project Maya's engine to gfx906 took it from 7 to about 10 tokens/s, and a ten-line fix to how it reads the Engram table removed the worst decode freezes. All five of my coding-agent tasks now pass on it.
Tags:
DeepSeek, AMD MI50, ROCm, gfx906, MoE, Project Maya, Strata, Claude Code
Sami
Sami
10 min read