{"id":546345,"date":"2018-12-03T12:03:07","date_gmt":"2018-12-03T20:03:07","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-project&p=546345"},"modified":"2024-04-03T12:34:47","modified_gmt":"2024-04-03T19:34:47","slug":"project-triton","status":"publish","type":"msr-project","link":"https:\/\/www.microsoft.com\/en-us\/research\/project\/project-triton\/","title":{"rendered":"Project Triton"},"content":{"rendered":"
\n\t
\n\t\t
\n\t\t\t\"Project\t\t<\/div>\n\t\t\n\t\t
\n\t\t\t\n\t\t\t
\n\t\t\t\t\n\t\t\t\t
\n\t\t\t\t\t\n\t\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\t<\/span>\n\t\t\t\t\t\t\t\t\tResearch for Industry\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\n\n

Project Triton<\/h1>\n\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t<\/div>\n\t\t<\/div>\n\t<\/div>\n<\/section>\n\n\n\n\n\n

Immersive sound propagation for games and mixed reality<\/h2>\n\n\n\n

Games and mixed reality must render a believable soundscape for the listener that situates characters and sounds within rich 3D worlds. Project Triton aids this task by physically modeling how sound propagates within a scene given its shape and materials. In doing so, it automatically models immersive sound propagation effects like sound occlusion and reverberation. Project Triton is unique in accurately modeling the true wave physics of sound, including diffraction, while still being fast enough to scale from desktop to mobile devices. Incubated over a decade of focused research, it is battle-tested technology, shipping in major game titles like Gears of War (opens in new tab)<\/span><\/a>, Sea of Thieves (opens in new tab)<\/span><\/a>, and Borderlands 3 (opens in new tab)<\/span><\/a>.<\/p>\n\n\n\n

Project Acoustics (opens in new tab)<\/span><\/a> provides easy-to-use plugin integration for Unity and Unreal game engines.<\/p>\n\n\n\n

Sound propagation effects<\/h2>\n\n\n\n
\n
\n

Obstruction<\/h3>\n\n\n\n
\"Project
Sound is weakened when it diffracts around obstructions\u200b.<\/figcaption><\/figure>\n<\/div>\n\n\n\n
\n

Occlusion<\/h3>\n\n\n\n
\"Project
Occlusion is total reduction in loudness from geometry, involving complex propagation and diffraction (diffracted paths in green)\u200b.<\/figcaption><\/figure>\n<\/div>\n\n\n\n
\n

Portaling (sound redirection)<\/h3>\n\n\n\n
\"Project
Sound heard \u201cthrough the wall\u201d (red) from source direction is incorrect\u200b. Doors redirect sounds, which is more believable\u200b.<\/figcaption><\/figure>\n<\/div>\n<\/div>\n\n\n\n
\n
\n

Reverberance<\/h3>\n\n\n\n
\"Project
Left: Close to the source, direct path (green) is loud compared to reflections (orange), resulting in high clarity and low reverberance. Right: Behind the partition, direct path is weakened from diffraction, causing low clarity and high reverberance, conveying that the source is in a different room.\u200b<\/figcaption><\/figure>\n<\/div>\n\n\n\n
\n

Decay time<\/h3>\n\n\n\n
\"Project
Larger rooms reverberate longer.\u200b<\/figcaption><\/figure>\n<\/div>\n\n\n\n
<\/div>\n<\/div>\n\n\n\n

We perceive many acoustic effects in everyday life that result from the wave nature of sound propagation. They keep us aware and oriented in our surroundings, varying smoothly as we and sounds around us move through the world. Games and mixed reality thus usually need to reproduce them for a natural soundscape. Project Triton models many such important effects, illustrated above. For instance, obstruction and “portaling” together create a believable impression of sounds flowing around doorways. It is common for sound designers to have to do tedious manual markup to obtain such results. Project Triton removes this tedium, driving the effects robustly from scene geometry and empowering the designer with new tools to shape physics for storytelling goals. For example, one can reduce physical reverberance on game dialogue to make it cinematic, while heightening the reverberation on footsteps to make a cave feel spookier. All at runtime while fitting within practical CPU and RAM budgets.<\/p>\n\n\n\n

\"How<\/figure>
\n

How it works<\/h2>\n\n\n\n

Project Triton models the actual wave physics of sound propagation through complex 3D spaces. Audible sounds have wavelengths from centimeters to meters so that wave effects must be modeled to avoid unnatural results. An example is the “lamppost problem” – a thin lamppost blocking the ray from source to listener can occlude as much as a concrete wall. We never hear that in reality because sound waves wrap around objects, as seen in the animation above. This is diffraction. It is central to how sound moves around corners and through doorways, scatters, and fills up various rooms with reverberation. Wave simulation is very expensive, so we precompute on static visual 3D geometry on a compute cluster in a \u201cbaking\u201d step. The overall pipeline is quite analogous to light baking, in that it moves expensive global propagation computation to a baking step – with the difference that moving sources are supported. This data is passed through a proprietary parametric compressor that drastically reduces data size and enables fast lookup and signal processing at runtime, enabling Triton to run even on mobile devices such as the Oculus Go.<\/p>\n<\/div><\/div>\n\n\n\n

Explore more<\/h3>\n\n\n\n
\n
\n
\n\t
\n\t\t
\n\t\t\t\t\t\tDocumentation<\/span>\n\t\t\tProject Acoustics<\/span> <\/span><\/a>\t\t\t\t\t\t\t

Find documentation and downloads for Project Acoustics.<\/p>\n\t\t\t\t\t<\/div>\n\t<\/article>\n<\/div>\n\n\n\n

\n\t
\n\t\t
\n\t\t\t\t\t\tPublication<\/span>\n\t\t\tParametric Wave Field Coding for Precomputed Sound Propagation<\/span> <\/span><\/a>\t\t\t\t\t\t\t

Describes the core algorithms and architecture of the system.<\/p>\n\t\t\t\t\t<\/div>\n\t<\/article>\n<\/div>\n\n\n\n

\n\t
\n\t\t
\n\t\t\t\t\t\tPublication<\/span>\n\t\t\tParametric Directional Coding for Precomputed Sound Propagation<\/span> <\/span><\/a>\t\t\t\t\t\t\t

Extends the above to model spatial audio effects such as portaling.<\/p>\n\t\t\t\t\t<\/div>\n\t<\/article>\n<\/div>\n<\/div>\n\n\n\n

\n
\n\t
\n\t\t
\n\t\t\t\t\t\tVideo<\/span>\n\t\t\tProject Acoustics at GDC 2019<\/span> <\/span><\/a>\t\t\t\t\t\t\t

An introductory talk on Project Acoustics and plugins for Unity and Unreal.<\/p>\n\t\t\t\t\t<\/div>\n\t<\/article>\n<\/div>\n\n\n\n

\n\t
\n\t\t
\n\t\t\t\t\t\tVideo<\/span>\n\t\t\tProject Triton at GDC 2017<\/span> <\/span><\/a>\t\t\t\t\t\t\t

A general introduction to the ideas behind Project Triton and its integration in Gears of War 4.<\/p>\n\t\t\t\t\t<\/div>\n\t<\/article>\n<\/div>\n<\/div>\n<\/div>\n\n\n\n

Product transfers<\/h2>\n\n\n\n