{"id":360452,"date":"2017-02-01T14:54:31","date_gmt":"2017-02-01T22:54:31","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-project&#038;p=360452"},"modified":"2017-06-12T09:36:39","modified_gmt":"2017-06-12T16:36:39","slug":"flashextract","status":"publish","type":"msr-project","link":"https:\/\/www.microsoft.com\/en-us\/research\/project\/flashextract\/","title":{"rendered":"FlashExtract"},"content":{"rendered":"<p><strong>(Programming-by-example APIs for extracting structured data from text\/log files by examples)<\/strong><\/p>\n<p>The FlashExtract technology (published as a PLDI 2014 paper [<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/flashextract-framework-data-extraction-examples\/\">pdf<\/a> |<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2016\/12\/pldi14-flashextract.pptx\">ppt slides<\/a> |<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/video\/programming-examples-pbe-flashextract\/\">Video<\/a> |<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/video\/programming-examples-pbe-flashextract-video-2\/\">Video 2<\/a>]) ships as features in Powershell and Azure OMS (Operations Management Suite).<\/p>\n<p>FlashExtract powers the ConvertFrom-String cmdlet in Powershell. Here&#8217;s a <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/blogs.msdn.com\/b\/powershell\/archive\/2014\/10\/31\/convertfrom-string-example-based-text-parsing.aspx\">Microsoft blogpost<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> that explains this cmdlet.<br \/>\nHere are some videos prepared by others to demonstrate this capability:<\/p>\n<ul type=\"disc\">\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/www.youtube.com\/watch?feature=player_detailpage&v=Hkzd8spCfCU&list=PLfeA8kIs7Coehjg9cB6foPjBojLHYQGb_#t=1401\">Example-driven parsing<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/dougfinke.com\/gifcam\/ConvertFromStringBuddy2.gif\">Doug Finke&#8217;s UI<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<\/ul>\n<h2>Here are some blogposts<\/h2>\n<ul type=\"disc\">\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/www.petri.com\/powershell-5-0-tutorial-example-driven-parsing-using-convertfrom-string\">Powershell PowerShell 5.0 Tutorial: Example-Driven Parsing using ConvertFrom-String <span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/www.powershellmagazine.com\/2014\/09\/09\/using-the-convertfrom-string-cmdlet-to-parse-structured-text\/\">Powershell Magazine<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>: Using the ConvertFrom-String cmdlet to parse structured text. &#8220;New kid on the block&#8221;<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/www.lazywinadmin.com\/2014\/09\/powershell-convertfrom-string-and.html\">LazyWinAdmin<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>: PowerShell &#8211; ConvertFrom-String and the TemplateFile parameter. &#8220;This is super cool !!&#8221;<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/www.dougfinke.com\/blog\/index.php\/2014\/10\/25\/powershell-convertfrom-string-serious-text-wrangling\/\">Doug Finke&#8217;s Blog<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>: PowerShell ConvertFrom-String: Serious Text wrangling<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/www.happysysadm.com\/2014\/11\/first-look-at-convertfrom-string-in.html\">Happy SysAdmin<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>: First look at ConvertFrom-String in Powershell v5. &#8220;must admit that this cmdlet is to me one of the best improvement that came with WMF5.0 and Powershell v5&#8221;<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/foxdeploy.com\/2015\/01\/13\/walkthrough-part-two-advanced-parsing-with-convertfrom-string\/\">Advanced Parsing with ConvertFrom-String<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>: &#8220;Machine learning will take our jobs&#8221;<\/li>\n<\/ul>\n<p>FlashExtract also powers the Custom-field feature in Azure Operations Management Suite (OMS) software. Here&#8217;s a Microsoft <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/blogs.technet.com\/b\/momteam\/archive\/2015\/08\/18\/create-your-own-fields-in-oms-with-custom-fields.aspx\">blogpost<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> and a <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/youtu.be\/V5wQDVxTQvs\">video<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> describing this feature.<\/p>\n<h2>Here are some other blogposts<\/h2>\n<ul type=\"disc\">\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/www.lumagate.com\/news\/operations-management-suite-%E2%80%93-custom-fields-\/-extract-data-feature\">Operations Management Suite \u2013 Custom Fields \/ Extract Data Feature<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/cloudadministrator.wordpress.com\/2015\/09\/14\/manage-custom-fields-in-operations-management-suite\/\">Manage Custom Fields in Operations Management Suite<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/blog.orneling.se\/2015\/08\/creating-custom-fields-in-oms\/\">Creating custom fields in OMS<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>(Programming-by-example APIs for extracting structured data from text\/log files by examples) The FlashExtract technology (published as a PLDI 2014 paper [pdf |ppt slides |Video |Video 2]) ships as features in Powershell and Azure OMS (Operations Management Suite). FlashExtract powers the ConvertFrom-String cmdlet in Powershell. Here&#8217;s a Microsoft blogpost that explains this cmdlet. Here are some [&hellip;]<\/p>\n","protected":false},"featured_media":0,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","footnotes":""},"research-area":[13560],"msr-locale":[268875],"msr-impact-theme":[],"msr-pillar":[],"class_list":["post-360452","msr-project","type-msr-project","status-publish","hentry","msr-research-area-programming-languages-software-engineering","msr-locale-en_us","msr-archive-status-active"],"msr_project_start":"2013-01-01","related-publications":[335339],"related-downloads":[],"related-videos":[359495,359501],"related-groups":[],"related-events":[],"related-opportunities":[],"related-posts":[],"related-articles":[],"tab-content":[],"slides":[],"related-researchers":[{"type":"user_nicename","value":"sumitg","display_name":"Sumit Gulwani","author_link":"<a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/sumitg\/\" aria-label=\"Visit the profile page for Sumit Gulwani\">Sumit Gulwani<\/a>","is_active":false,"user_id":33755,"last_first":"Gulwani, Sumit","people_section":0,"alias":"sumitg"}],"msr_research_lab":[],"msr_impact_theme":[],"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/360452","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-project"}],"version-history":[{"count":1,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/360452\/revisions"}],"predecessor-version":[{"id":360455,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/360452\/revisions\/360455"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=360452"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=360452"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=360452"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=360452"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=360452"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}