high-bandwidth memories

musings on deep learning systems

Speed, Python: Pick Two. How CUDA Graphs Enable Fast Python Code for Deep Learning

17 min read · August 29, 2023 · medium.com

2023
Fireworks.ai: Fast, Affordable, Customizable Gen AI Platform

8 min read · August 17, 2023 · medium.com

2023
Multi-Query Attention is All You Need

18 min read · July 13, 2023 · medium.com

2023