#cuTile

A Coding Guide to NVIDIA’s Tile-Based GPU Programming: From cuTile and Triton Kernels to Flash Attention

This article explains tile-based GPU programming concepts, focusing on NVIDIA's cuTile and Triton frameworks, and how they enable efficient Flash Attention in large language models.