TurboAttention: Efficient Attention Approximation For High Throughputs LLMs
Hao Kang, Srikant Bharadwaj, James Hensman, Tushar Krishna, Victor Ruehle, Saravan Rajmohan
ArXiv | December 2024, Vol abs/2412.08585
Efficient AI team
Kernel‑level innovation and hardware‑aware modeling
Publications
-
-
-
LeanAttention: Hardware-Aware Scalable Attention Mechanism for the Decode-Phase of Transformers
Rya Sanovar, Srikant Bharadwaj, Renee St. Amant, Victor Ruehle, Saravan Rajmohan
May 2024
-
Predict; Don’t React for Enabling Efficient Fine-Grain DVFS in GPUs
Srikant Bharadwaj, Shomit Das, K. Mazumdar, Bradford M. Beckmann, Stephen Kosonocky
Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems | March 2024
-
-
-
RETROSPECTIVE: Dark Silicon and the End of Multicore Scaling
Hadi Esmaeilzadeh, Emily Blem, Renee St. Amant, Karthikeyan Sankaralingam, Doug Burger
ISCA@50 25-Year Retrospective: 1996-2020 | Published by ACM SIGARCH and IEEE TCCA | 2023
-
RETROSPECTIVE: General-Purpose Code Acceleration with Limited-Precision Analog Computation
Renee St. Amant, Amir Yazdanbakhsh, Jongse Park, Hadi Esmaeilzadeh, Arjang Hassibi, Luis Ceze, Doug Burger
ISCA@50 25-Year Retrospective: 1996-2020 | Published by ACM SIGARCH and IEEE TCCA | 2023
-
-
-
TurboAttention: Efficient Attention Approximation For High Throughputs LLMs
Hao Kang, Srikant Bharadwaj, James Hensman, Tushar Krishna, Victor Ruehle, Saravan Rajmohan
ArXiv | December 2024, Vol abs/2412.08585
-
LeanAttention: Hardware-Aware Scalable Attention Mechanism for the Decode-Phase of Transformers
Rya Sanovar, Srikant Bharadwaj, Renee St. Amant, Victor Ruehle, Saravan Rajmohan
May 2024
-
RETROSPECTIVE: General-Purpose Code Acceleration with Limited-Precision Analog Computation
Renee St. Amant, Amir Yazdanbakhsh, Jongse Park, Hadi Esmaeilzadeh, Arjang Hassibi, Luis Ceze, Doug Burger
ISCA@50 25-Year Retrospective: 1996-2020 | Published by ACM SIGARCH and IEEE TCCA | 2023
-
-
-
LeanAttention: Hardware-Aware Scalable Attention Mechanism for the Decode-Phase of Transformers
Rya Sanovar, Srikant Bharadwaj, Renee St. Amant, Victor Ruehle, Saravan Rajmohan
May 2024
-
Predict; Don’t React for Enabling Efficient Fine-Grain DVFS in GPUs
Srikant Bharadwaj, Shomit Das, K. Mazumdar, Bradford M. Beckmann, Stephen Kosonocky
Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems | March 2024
-
RETROSPECTIVE: Dark Silicon and the End of Multicore Scaling
Hadi Esmaeilzadeh, Emily Blem, Renee St. Amant, Karthikeyan Sankaralingam, Doug Burger
ISCA@50 25-Year Retrospective: 1996-2020 | Published by ACM SIGARCH and IEEE TCCA | 2023
-
RETROSPECTIVE: General-Purpose Code Acceleration with Limited-Precision Analog Computation
Renee St. Amant, Amir Yazdanbakhsh, Jongse Park, Hadi Esmaeilzadeh, Arjang Hassibi, Luis Ceze, Doug Burger
ISCA@50 25-Year Retrospective: 1996-2020 | Published by ACM SIGARCH and IEEE TCCA | 2023
-
-
-
-
TurboAttention: Efficient Attention Approximation For High Throughputs LLMs
Hao Kang, Srikant Bharadwaj, James Hensman, Tushar Krishna, Victor Ruehle, Saravan Rajmohan
ArXiv | December 2024, Vol abs/2412.08585
-
-
-
RETROSPECTIVE: Dark Silicon and the End of Multicore Scaling
Hadi Esmaeilzadeh, Emily Blem, Renee St. Amant, Karthikeyan Sankaralingam, Doug Burger
ISCA@50 25-Year Retrospective: 1996-2020 | Published by ACM SIGARCH and IEEE TCCA | 2023
-
RETROSPECTIVE: General-Purpose Code Acceleration with Limited-Precision Analog Computation
Renee St. Amant, Amir Yazdanbakhsh, Jongse Park, Hadi Esmaeilzadeh, Arjang Hassibi, Luis Ceze, Doug Burger
ISCA@50 25-Year Retrospective: 1996-2020 | Published by ACM SIGARCH and IEEE TCCA | 2023
-
-
-
-
Predict; Don’t React for Enabling Efficient Fine-Grain DVFS in GPUs
Srikant Bharadwaj, Shomit Das, K. Mazumdar, Bradford M. Beckmann, Stephen Kosonocky
Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems | March 2024
-