Tag
5 articles
Tencent open-sources AngelSpec, a torch-native framework for speculative decoding that introduces DFly, a block-diffusion drafter, and achieves significant speedups in LLM inference.
Learn how DSpark, a new AI framework from DeepSeek, speeds up text generation in AI models by making smart guesses and verifying only when necessary, without sacrificing accuracy.
Researchers at UC San Diego introduce DFlash, a new speculative decoding technique that drafts whole token blocks in parallel, achieving up to 15x throughput improvement on NVIDIA Blackwell.
EAGLE 3.1, developed by the EAGLE team, vLLM, and TorchSpec, tackles attention drift in LLM inference, enhancing speculative decoding stability for production use.
Learn how speculative decoding helps AI systems generate text faster without losing accuracy, using a fast guess-and-check method.
