Tag
1 article
Tencent open-sources AngelSpec, a torch-native framework for speculative decoding that introduces DFly, a block-diffusion drafter, and achieves significant speedups in LLM inference.