Tag
1 article
This article explains FreeToken, an edge-native serving engine that enables large MoE models to run on a single workstation GPU by intelligently managing cache misses through PCIe bandwidth and CPU execution.