{"id":1163453,"date":"2026-03-06T07:39:05","date_gmt":"2026-03-06T15:39:05","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-video&#038;p=1163453"},"modified":"2026-03-06T07:39:06","modified_gmt":"2026-03-06T15:39:06","slug":"cross-leveraging-ai-asics-for-homomorphic-encryption","status":"publish","type":"msr-video","link":"https:\/\/www.microsoft.com\/en-us\/research\/video\/cross-leveraging-ai-asics-for-homomorphic-encryption\/","title":{"rendered":"CROSS \u2014 Leveraging AI ASICs for Homomorphic Encryption"},"content":{"rendered":"\n<p>Artificial Intelligence (AI) is driving a new industrial revolution, transforming human workflows increasingly into digital tokens, i.e., tokenizing the entire world. However, this transformation exposes sensitive data at an unprecedented scale, leading to heavy privacy breaches that\u00a0stalled AI&#8217;s adoption. Homomorphic Encryption (HE) provides strong data privacy for cloud services but at the cost of prohibitive computational overhead. While GPUs have emerged as a practical platform for accelerating, HE, there remains an order-of-magnitude energy-efficiency gap compared to specialized (but expensive) HE ASICs. This talk explores an alternate direction: leveraging existing AI accelerators, like Google&#8217;s TPUs, to accelerate homomorphic encryption and broadly cryptography primitives. The key focus is the advanced compilation techniques that could transform &#8220;any application with static scheduling of modular arithmetic\u201d into kernels natively supported by AI ASICs such TPU\u00a0without any hardware modification for acceleration. Our evaluation shows that CROSS achieving the SoTA throughput in NTT and HE operators, SoTA energy efficiency among commodity devices including CPUs, GPUs and FPGAs.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Paper: <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/arxiv.org\/pdf\/2501.07047v3\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/arxiv.org\/pdf\/2501.07047v3<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n\n\n\n<li>Code: <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/github.com\/EfficientPPML\/CROSS\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/github.com\/EfficientPPML\/CROSS<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n\n\n\n<li>Tutorial: <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/github.com\/EfficientPPML\/CROSS_Tutorial\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/github.com\/EfficientPPML\/CROSS_Tutorial<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<\/ul>\n\n\n\n<p>TL;DR:&nbsp;CROSS is the first project to demonstrate that Homomorphic Encryption operators with static scheduling of modular arithmetic could be transformed into kernels suitable for TPU, inheriting the SoTA energy efficiency and throughput of modern AI ASICs without any hardware modification. This paves the road for accelerating broad cryptography primitives on AI ASICs like Google\u2019s TPU, sparking a new direction of hardware-friendly protocol design.<\/p>\n\n\n\n<h2 class=\"wp-block-heading h4\" id=\"speaker-bio\">Speaker bio<\/h2>\n\n\n\n<p><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/jianmingtong.github.io\" type=\"link\" id=\"https:\/\/jianmingtong.github.io\">Jianming Tong<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> is\u00a0a 5th-year PhD\u00a0candidate at Georgia Tech,\u00a0advised by Tushar Krishna\u00a0(GT), he is\u00a0a computer architect\u00a0focusing on focusing on system for AI and Cryptography, i.e., enabling today\u2019s AI systems to work in a privacy-preserving manner without sacrificing performance.\u00a0<\/p>\n\n\n\n<p>A few representative highlights:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>CROSS Compiler (HPCA\u201926\u00a0with Google, MLSys\u201924):\u00a0Converts\u00a0Homomorphic Encryption workloads into AI workloads\u00a0to be executed efficiently on TPUs, enabling immediate, scalable, and low-cost privacy-preserving AI on existing AI accelerators without hardware modifications.<\/li>\n\n\n\n<li>Reconfigurable Accelerator (ISCA&#8217;24):\u00a0Proposes next-gen computer architecture with the capability of dataflow-layout co-switching\u00a0to sustain high compute utilization\u00a0for workloads with irregular shapes.<\/li>\n\n\n\n<li>His works are deployed in NVIDIA\u00a0(NV\u00a0Labs) and Google\u00a0(Jaxite), and recognized by 2nd place in university demo @ DAC, Qualcomm Innovation Fellowship, Machine Learning and System Rising\u00a0Star, and GT NEXT Award.<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Artificial Intelligence (AI) is driving a new industrial revolution, transforming human workflows increasingly into digital tokens, i.e., tokenizing the entire world. However, this transformation exposes sensitive data at an unprecedented scale, leading to heavy privacy breaches that\u00a0stalled AI&#8217;s adoption. Homomorphic Encryption (HE) provides strong data privacy for cloud services but at the cost of prohibitive [&hellip;]<\/p>\n","protected":false},"featured_media":1163458,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","msr_hide_image_in_river":0,"footnotes":""},"research-area":[13558],"msr-video-type":[269676],"msr-locale":[268875],"msr-post-option":[],"msr-session-type":[],"msr-impact-theme":[],"msr-pillar":[],"msr-episode":[],"msr-research-theme":[],"class_list":["post-1163453","msr-video","type-msr-video","status-publish","has-post-thumbnail","hentry","msr-research-area-security-privacy-cryptography","msr-video-type-cryptography-talk-series","msr-locale-en_us"],"msr_download_urls":"","msr_external_url":"https:\/\/youtu.be\/cN79ELoecNI","msr_secondary_video_url":"","msr_video_file":"http:\/\/0","_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video\/1163453","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-video"}],"version-history":[{"count":2,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video\/1163453\/revisions"}],"predecessor-version":[{"id":1163462,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video\/1163453\/revisions\/1163462"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/1163458"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=1163453"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=1163453"},{"taxonomy":"msr-video-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-video-type?post=1163453"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=1163453"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=1163453"},{"taxonomy":"msr-session-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-session-type?post=1163453"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=1163453"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=1163453"},{"taxonomy":"msr-episode","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-episode?post=1163453"},{"taxonomy":"msr-research-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-research-theme?post=1163453"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}