We reverse-engineered Flash Attention 4
via modal.com
Short excerpt below. Read at the original source.
Article URL: https://modal.com/blog/reverse-engineer-flash-attention-4 Comments URL: https://news.ycombinator.com/item?id=45399637 Points: 16 # Comments: 3