Application samples

Discover innovative applications and learn how to extend your projects with AI.

Machine teaching Sketch2Code JFK Files Style Transfer Snip Insights Vector search

The need

What if users could use tools to streamline repetitive tasks? People rely on visual information to find and index things, source new ideas, and learn new things—but visual information can be hard to translate to a technical environment.

The idea

Using visual information involves lots of repetitive steps. AI helps simplify how you use images. Identify famous people or landmarks, turn a scan of a book into text, or find a pair of shoes based on a photo—in one app.

The solution

Snip Insights is an open source desktop utility that helps users retrieve intelligent insights from a snip or screenshot. Snip Insights leverages cloud AI services to convert images to translated text and make smart image suggestions.

Technical details for Snip Insights

Snip Insights is an open source desktop utility that retrieves intelligent insights from a snip or screenshot. Snip Insights leverages cloud AI services to convert images to translated text, automatically detect and tag image content, and make smart image suggestions—showcasing Azure Cognitive Services’ potential.

Imagine that you have a scan of a textbook or work report. Rather than having to manually type out the information, snipping it will return editable text from an image. Or maybe you’re scrolling through your social media feed and come across someone wearing a cool pair of shoes—you can snip to find where to purchase them. Snip Insights can also find information based on an image—including identifying famous people and landmarks. It streamlines the process of screenshotting, saving the picture, uploading it to reverse image search engines, and then drawing results from there.

Installation

Windows

  1. Download the zip for Windows.
  2. Install the certificate (".cer" file) according the instructions detailed on Install Certificate section.
  3. Install Snip Insights by double click over the .appx package file.

Linux

  1. Install Mono by following the official steps depending on your Linux distribution.
  2. Install the .deb package.
  3. Launch the app form the application section.

MacOS

  1. Download and install Mono (Stable channel). This includes GTK#, the UI toolkit used by Xamarin.Forms for this project.
  2. Install the .pkg as a normal MacOS application.
  3. Snip Insights app is available on Applications section on MacOS.

Explore the possibilities of AI

Find demos to get more ideas or learn about AI technology to jumpstart your own development.