A Framework for Multimodal Data Collection, Visualization, Annotation, and Learning

  • Anne Loomis Thompson, Microsoft

The development and iterative refinement of inference models for multimodal systems can be challenging and time intensive. We present a framework for multimodal data collection, visualization, annotation, and learning that enables system developers to build models using various machine learning techniques, and quickly iterate through cycles of development, deployment and refinement.