{"id":235453,"date":"2015-04-09T06:00:00","date_gmt":"2015-04-09T06:00:00","guid":{"rendered":"https:\/\/blogs.technet.microsoft.com\/inside_microsoft_research\/2015\/04\/09\/probabilistic-programming-goes-large-scale-from-reducing-email-clutter-to-any-machine-learning-task\/"},"modified":"2016-07-20T07:29:23","modified_gmt":"2016-07-20T14:29:23","slug":"probabilistic-programming-goes-large-scale-from-reducing-email-clutter-to-any-machine-learning-task","status":"publish","type":"post","link":"https:\/\/www.microsoft.com\/en-us\/research\/blog\/probabilistic-programming-goes-large-scale-from-reducing-email-clutter-to-any-machine-learning-task\/","title":{"rendered":"Probabilistic programming goes large scale: From reducing email clutter to any machine learning task"},"content":{"rendered":"

Posted by George Thomas Jr.<\/span><\/p>\n

How is it you seem to be spending more and more time every day sifting through and prioritizing email messages? According to research by The Radicati Group, Inc., the legitimate emails you receive \u2014\u00a0already upwards of 100 per day \u2014\u00a0will only continue to increase. So how can you stem the tide of information overload without sacrificing more of your already precious time?<\/p>\n

That’s where probabilistic programming becomes relevant to Microsoft’s efforts to enhance productivity. In what is believed to be the first large-scale commercial use of this innovative programming paradigm, a recently released feature in Office 365 called Clutter (opens in new tab)<\/span><\/a> intelligently learns which emails matter most to you and sorts them accordingly, filtering those less-urgent emails into a Clutter folder and allowing users to focus on the most immediately important emails.<\/p>\n

\"Probabilistic<\/p>\n

Given that computer programming is based on precision coding, “probabilistic programming (opens in new tab)<\/span><\/a>” may seem like an oxymoron, but probability and uncertainty actually are key to its charm, especially when applied to machine learning (opens in new tab)<\/span><\/a>.<\/p>\n

“It’s a way of doing machine learning without writing algorithms,” says John Winn (opens in new tab)<\/span><\/a>, a Principal Researcher at Microsoft’s research lab in Cambridge, U.K. (opens in new tab)<\/span><\/a>, whose team collaborated on the development of Clutter.<\/p>\n

In standard computer programs, variables have set values, but in probabilistic programs, variables can have uncertain values. For example, a variable could have a value some-number-between-1-and-100<\/i>. This ability allows for don’t-know<\/i> variables in the program, the values of which you want to learn from data.<\/p>\n

Probabilistic programming is a method of reasoning backwards from given data by assuming it was the output of the program with some setting of the don’t-know<\/i> variables. This lets you learn about the value of these variables, without having to write a machine learning algorithm.<\/p>\n

One tool for probabilistic programming is Infer.NET (opens in new tab)<\/span><\/a>, a .NET compiler and runtime Winn and his colleagues created and in turn applied to the development of Clutter.<\/p>\n

“You write a simulator of the world, which is a probabilistic program, and Infer.NET takes that program and runs it backwards,” he says.<\/p>\n

The machine learning underlying Clutter examines how users prioritize email and, over time, learns from users’ patterns and infers which emails can automatically be sorted into the Clutter folder for later reading, thus reducing inbox clutter.<\/p>\n