Roast topics
Find topics
Roast it!
Roast topics
Find topics
Find it!
Login
From:
PyTorch
(Uncensored)
subscribe
Fast 2-Simplicial Attention: Hardware-Efficient Kernels in TLX
https://pytorch.org/blog/fast-2-simplicial-attention-hardware-efficient-kernels-in-tlx/
links
backlinks
Tagged with:
blog
In this blog post, we explore the kernel design details presented in the paper Fast and Simplex: 2-Simplicial Attention in Triton [1]. We begin by modeling the 2-Simplicial attention algorithm...