Recently, Transformer-based deep learning models like GPT-3 have been getting a lot of attention in the machine learning world. These models excel at understanding semantic relationships, and they have contributed to large improvements in Microsoft Bing’s search experience (opens in new tab) and surpassing human…
“I’ll put a link to that doc in the chat” “Sorry, my internet is terrible, I’ll put my question in the chat” “That GIF from Amy in the chat is hilarious” If these phrases sound familiar to you, you’re not alone – people the world…
In the pursuit of learning about fundamentals of the natural world, scientists have had success with coming at discoveries from both a bottom-up and top-down approach. Neuroscience is a great example of the former. Spanish anatomist Santiago Ramón y Cajal discovered the neuron in the…
In November, NYU media professor Charlton McIlwain (opens in new tab) joined fellow scholars Safiya Noble, Ruha Benjamin, and André Brock for a virtual discussion on anti-Blackness and technology hosted by the University of California Santa Barbara. The conversation was an engaging one, and McIlwain…
Editor’s note: In recent years, telecommunications operators have faced a growing challenge to meet surging global demand for immersive online services and collaboration tools. Upgrading their proprietary networks to prepare for 5G and beyond would require major capital expenditures, even as competition was driving down…
The ability to reason about causality, and ask ``what would happen if…?’’ is one property that sets human intelligence apart from artificial intelligence. Modern AI algorithms perform well on clearly defined pattern recognition tasks but fall short generalizing in the ways that human intelligence can.…
For many years AI researchers have sought to build upon traditional machine learning, which trains technology to process facts and learn from them, and develop machine reasoning, in which programs apply logic to data and solve problems – comparable to the way humans think. For…
The increasing use of personal assistants and messaging applications has spurred interest in building task-oriented dialog systems (or task bots) that can communicate with users through natural language to accomplish a wide range of tasks, such as restaurant booking, weather query, flight booking, or IT…
A Generative adversarial network, or GAN, is one of the most powerful machine learning models proposed by Goodfellow et al. (opens in new tab) for learning to generate samples from complicated real-world distributions. GANs have sparked millions of applications, ranging from generating realistic images or…
AI agents capable of understanding natural language, communicating, and accomplishing tasks hold the promise of revolutionizing the way we interact with computers in our everyday lives. Text-based games, such as the Zork series, act as testbeds for development of novel learning agents capable of understanding…
“If you think about the world that we’re in now, software plays a key role in our lives – in everything we do. And at the core of solving big problems and fundamental challenges is the ability to use software to attack the problem and…
Last month, the DeepSpeed Team announced ZeRO-Infinity, a step forward in training models with tens of trillions of parameters. In addition to creating optimizations for scale, our team strives to introduce features that also improve speed, cost, and usability. As the DeepSpeed optimization library evolves,…
Meet our community of researchers, learn about exciting research topics, and grow your network
Ongoing conversations at the cutting edge of research
Join us for a continuous exchange of ideas about research in the era of general AI
