{"id":293852,"date":"2016-09-18T23:27:26","date_gmt":"2016-09-19T06:27:26","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-project&#038;p=293852"},"modified":"2017-06-13T16:49:52","modified_gmt":"2017-06-13T23:49:52","slug":"qna-miner","status":"publish","type":"msr-project","link":"https:\/\/www.microsoft.com\/en-us\/research\/project\/qna-miner\/","title":{"rendered":"QnA Miner"},"content":{"rendered":"<p><strong>Goal:<\/strong><\/p>\n<p>Q&A is an important knowledge data to enable many scenarios like auto question answering in bot. This Q&A miner provide a platform to 1. Extract Q&A data automatically w\/ human knowledge in loop. 2. Mine sematic tags like domain, entity, relation as well as intent and condition from Q&A data. Q&A extraction contains two parts: FAQ extraction from both web pages and enterprise documents like word, and Q&A extraction to extract from crowd sourcing data like online forum. After we extract many Q&A pairs, Q&A Miner learns the semantic tags by using NER, intent taxonomy mining and recognition, conditional knowledge mining as well as question linking techniques.<\/p>\n<p><strong>Portal:<\/strong> <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/msraml-s004:2410\/\">http:\/\/msraml-s004:2410\/<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-medium wp-image-294068\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2016\/09\/5-300x221.png\" alt=\"5\" width=\"300\" height=\"221\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2016\/09\/5-300x221.png 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2016\/09\/5-768x567.png 768w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2016\/09\/5-80x60.png 80w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2016\/09\/5.png 882w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/>\u00a0\u00a0 <img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-medium wp-image-294074\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2016\/09\/7-300x284.png\" alt=\"7\" width=\"300\" height=\"284\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2016\/09\/7-300x284.png 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2016\/09\/7.png 599w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/p>\n<p><strong>Scope:<\/strong><\/p>\n<p><strong><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-294071\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2016\/09\/6-300x136.png\" alt=\"6\" width=\"439\" height=\"199\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2016\/09\/6-300x136.png 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2016\/09\/6-768x349.png 768w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2016\/09\/6.png 999w\" sizes=\"auto, (max-width: 439px) 100vw, 439px\" \/><\/strong><\/p>\n<p><strong>Techniques:<\/strong><\/p>\n<p>QnA Extraction provide an active framework to extract QnA pairs from web pages. This pipeline can not only extract QnA pairs by using existing model, but also provide a human in loop way for users to help to improve the performance. The unconfident pages will be selected to ask users to\u00a0label QnA, and the newly labeled data will be fed into the classifier to fine tune the model to achieve better performance.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-294080\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2016\/09\/8.png\" alt=\"8\" width=\"285\" height=\"269\" \/><\/p>\n<p>QnA Mining can learn the semantic tag from the QnA like domain, entity, intent and condition.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-medium wp-image-294083\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2016\/09\/9-300x137.png\" alt=\"9\" width=\"300\" height=\"137\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2016\/09\/9-300x137.png 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2016\/09\/9-768x351.png 768w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2016\/09\/9-1024x468.png 1024w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2016\/09\/9.png 1032w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/p>\n<p><strong>Application:<\/strong><\/p>\n<p>Digital doctor<\/p>\n<p>Customer support<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Goal: Q&A is an important knowledge data to enable many scenarios like auto question answering in bot. This Q&A miner provide a platform to 1. Extract Q&A data automatically w\/ human knowledge in loop. 2. Mine sematic tags like domain, entity, relation as well as intent and condition from Q&A data. Q&A extraction contains two [&hellip;]<\/p>\n","protected":false},"featured_media":0,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","footnotes":""},"research-area":[13556],"msr-locale":[268875],"msr-impact-theme":[],"msr-pillar":[],"class_list":["post-293852","msr-project","type-msr-project","status-publish","hentry","msr-research-area-artificial-intelligence","msr-locale-en_us","msr-archive-status-active"],"msr_project_start":"2015-12-01","related-publications":[],"related-downloads":[],"related-videos":[],"related-groups":[],"related-events":[],"related-opportunities":[],"related-posts":[],"related-articles":[],"tab-content":[],"related-researchers":[{"type":"user_nicename","value":"leiji","display_name":"Lei Ji","author_link":"<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/leiji\/\" aria-label=\"Visit the profile page for Lei Ji\">Lei Ji<\/a>","is_active":false,"user_id":32636,"last_first":"Ji, Lei","people_section":0,"alias":"leiji"}],"msr_research_lab":[],"msr_impact_theme":[],"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/293852","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-project"}],"version-history":[{"count":4,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/293852\/revisions"}],"predecessor-version":[{"id":390380,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/293852\/revisions\/390380"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=293852"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=293852"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=293852"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=293852"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=293852"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}