Snip Insights helps users find intelligent insights from a snip or screenshot. AI services convert a captured image to translated text, automatically detecting and tagging image content.Get Snip Insights source code
What if users could use tools to streamline repetitive tasks? People rely on visual information to find and index things, source new ideas, and learn new things—but visual information can be hard to translate to a technical environment.
Using visual information involves lots of repetitive steps. AI helps simplify how you use images. Identify famous people or landmarks, turn a scan of a book into text, or find a pair of shoes based on a photo—in one app.
Snip Insights is an open source desktop utility that helps users retrieve intelligent insights from a snip or screenshot. Snip Insights leverages cloud AI services to convert images to translated text and make smart image suggestions.
AI screen capture with Snip Insights
Convert images to translated text, detect and tag image content, start an image search directly from a snip, and even shop for a new discovery—all from a single app.
Technical details for Snip Insights
Snip Insights is an open source desktop utility that retrieves intelligent insights from a snip or screenshot. Snip Insights leverages cloud AI services to convert images to translated text, automatically detect and tag image content, and make smart image suggestions—showcasing Azure Cognitive Services’ potential.
Imagine that you have a scan of a textbook or work report. Rather than having to manually type out the information, snipping it will return editable text from an image. Or maybe you’re scrolling through your social media feed and come across someone wearing a cool pair of shoes—you can snip to find where to purchase them. Snip Insights can also find information based on an image—including identifying famous people and landmarks. It streamlines the process of screenshotting, saving the picture, uploading it to reverse image search engines, and then drawing results from there.
- Download the zip for Windows.
- Install the certificate (".cer" file) according the instructions detailed on Install Certificate section.
- Install Snip Insights by double click over the .appx package file.
- Install Mono by following the official steps depending on your Linux distribution.
- Install the .deb package.
- Launch the app form the application section.
Sketch2Code converts hand-written drawings to HTML prototypes. Designers share ideas on a whiteboard, then changes are shown instantly in the browser—helping improve collaboration between the designer, developer, and customer.
Pix2Story uses Natural Language Processing (NLP) for storytelling. AI scans a picture, applies a writing style, and generates a story—demonstrating how AI can drive creativity.
Microsoft Math uses optical character recognition (OCR) for handwriting to extract a math equation from a student’s photo of their notes. The problem is then standardized, classified, solved, and returned with solution steps and similar problems.
Celebs Like Me
Celebs Like Me uses facial recognition to match the user’s photo to similar-looking celebrities. Powered by a Deep Neural Net (DNN) model, it was trained using Bing Satori Knowledge Graph and Bing Image Graph.
Explore the possibilities of AI
Jumpstart your own AI innovations with learning resources and development solutions from Microsoft AI.
Learn to create your own AI experiences with courses in AI technology. Engage with learning paths in conversational AI, machine learning, AI for devices, cognitive services, autonomous systems, AI business strategies, and responsible AI.
Start building AI solutions with powerful tools and services. Microsoft AI is a robust framework for developing AI solutions in conversational AI, machine learning, data sciences, robotics, IoT, and more.