{"id":989034,"date":"2023-12-04T13:19:15","date_gmt":"2023-12-04T21:19:15","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-research-item&#038;p=989034"},"modified":"2024-07-31T11:44:52","modified_gmt":"2024-07-31T18:44:52","slug":"early-llm-based-tools-for-enterprise-information-workers-likely-provide-meaningful-boosts-to-productivity","status":"publish","type":"msr-research-item","link":"https:\/\/www.microsoft.com\/en-us\/research\/publication\/early-llm-based-tools-for-enterprise-information-workers-likely-provide-meaningful-boosts-to-productivity\/","title":{"rendered":"Early LLM-based Tools for Enterprise Information Workers Likely Provide Meaningful Boosts to Productivity"},"content":{"rendered":"<p>This report presents the initial findings of Microsoft\u2019s research initiative on \u201cAI and Productivity\u201d, which seeks to measure and accelerate the productivity gains created by LLM-powered productivity tools like Microsoft\u2019s Copilot. The many studies summarized in this report, the initiative\u2019s first, focus on common enterprise information worker tasks for which LLMs are most likely to provide significant value. Results from the studies support the hypothesis that the first versions of Copilot tools substantially increase productivity on these tasks. This productivity boost usually appeared in the studies as a meaningful increase in speed of execution without a significant decrease in quality. Furthermore, we observed that the willingness-to-pay for LLM-based tools is higher for people who have used the tools than those who have not, suggesting that the tools provide value above initial expectations. The report also highlights future directions for the AI and Productivity initiative, including an emphasis on approaches that capture a wider range of tasks and roles.<\/p>\n<p>&#8212;&#8211;<\/p>\n<p>We have since released a second AI & Productivity report <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/generative-ai-in-real-world-workplaces\/\">Generative AI in Real-World Workplaces<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>This report presents the initial findings of Microsoft\u2019s research initiative on \u201cAI and Productivity\u201d, which seeks to measure and accelerate the productivity gains created by LLM-powered productivity tools like Microsoft\u2019s Copilot. The many studies summarized in this report, the initiative\u2019s first, focus on common enterprise information worker tasks for which LLMs are most likely to [&hellip;]<\/p>\n","protected":false},"featured_media":0,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","msr-author-ordering":null,"msr_publishername":"","msr_publisher_other":"","msr_booktitle":"","msr_chapter":"","msr_edition":"","msr_editors":"","msr_how_published":"","msr_isbn":"","msr_issue":"","msr_journal":"","msr_number":"MSR-TR-2023-43","msr_organization":"Microsoft","msr_pages_string":"","msr_page_range_start":"","msr_page_range_end":"","msr_series":"","msr_volume":"","msr_copyright":"","msr_conference_name":"","msr_doi":"","msr_arxiv_id":"","msr_s2_paper_id":"","msr_mag_id":"","msr_pubmed_id":"","msr_other_authors":"","msr_other_contributors":"","msr_speaker":"","msr_award":"","msr_affiliation":"","msr_institution":"","msr_host":"","msr_version":"","msr_duration":"","msr_original_fields_of_study":"","msr_release_tracker_id":"","msr_s2_match_type":"","msr_citation_count_updated":"","msr_published_date":"2023-12-4","msr_highlight_text":"","msr_notes":"","msr_longbiography":"","msr_publicationurl":"","msr_external_url":"","msr_secondary_video_url":"","msr_conference_url":"","msr_journal_url":"","msr_s2_pdf_url":"","msr_year":0,"msr_citation_count":0,"msr_influential_citations":0,"msr_reference_count":0,"msr_s2_match_confidence":0,"msr_microsoftintellectualproperty":true,"msr_s2_open_access":false,"msr_s2_author_ids":[],"msr_pub_ids":[],"msr_hide_image_in_river":0,"footnotes":""},"msr-research-highlight":[],"research-area":[13556,13548,13554],"msr-publication-type":[193718],"msr-publisher":[],"msr-focus-area":[],"msr-locale":[268875],"msr-post-option":[],"msr-field-of-study":[246694,251059,248485],"msr-conference":[],"msr-journal":[],"msr-impact-theme":[],"msr-pillar":[],"class_list":["post-989034","msr-research-item","type-msr-research-item","status-publish","hentry","msr-research-area-artificial-intelligence","msr-research-area-economics","msr-research-area-human-computer-interaction","msr-locale-en_us","msr-field-of-study-artificial-intelligence","msr-field-of-study-economics","msr-field-of-study-human-computer-interaction"],"msr_publishername":"","msr_edition":"","msr_affiliation":"","msr_published_date":"2023-12-4","msr_host":"","msr_duration":"","msr_version":"","msr_speaker":"","msr_other_contributors":"","msr_booktitle":"","msr_pages_string":"","msr_chapter":"","msr_isbn":"","msr_journal":"","msr_volume":"","msr_number":"MSR-TR-2023-43","msr_editors":"","msr_series":"","msr_issue":"","msr_organization":"Microsoft","msr_how_published":"","msr_notes":"","msr_highlight_text":"","msr_release_tracker_id":"","msr_original_fields_of_study":"","msr_download_urls":"","msr_external_url":"","msr_secondary_video_url":"","msr_longbiography":"","msr_microsoftintellectualproperty":1,"msr_main_download":"","msr_publicationurl":"","msr_doi":"","msr_publication_uploader":[{"type":"file","viewUrl":"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2023\/12\/AI-and-Productivity-Report-First-Edition.pdf","id":"989259","title":"ai-and-productivity-report-first-edition","label_id":"243109","label":0}],"msr_related_uploader":"","msr_citation_count":0,"msr_citation_count_updated":"","msr_s2_paper_id":"","msr_influential_citations":0,"msr_reference_count":0,"msr_arxiv_id":"","msr_s2_author_ids":[],"msr_s2_open_access":false,"msr_s2_pdf_url":null,"msr_attachments":[{"id":989259,"url":"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2023\/12\/AI-and-Productivity-Report-First-Edition.pdf"}],"msr-author-ordering":[{"type":"text","value":"Alexia Cambon","user_id":0,"rest_url":false},{"type":"user_nicename","value":"Brent Hecht","user_id":38997,"rest_url":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/microsoft-research\/v1\/researchers?person=Brent Hecht"},{"type":"user_nicename","value":"Benjamin Edelman","user_id":37733,"rest_url":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/microsoft-research\/v1\/researchers?person=Benjamin Edelman"},{"type":"user_nicename","value":"Donald Ngwe","user_id":39630,"rest_url":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/microsoft-research\/v1\/researchers?person=Donald Ngwe"},{"type":"user_nicename","value":"Sonia Jaffe","user_id":37664,"rest_url":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/microsoft-research\/v1\/researchers?person=Sonia Jaffe"},{"type":"guest","value":"amy-heger","user_id":870591,"rest_url":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/microsoft-research\/v1\/researchers?person=amy-heger"},{"type":"user_nicename","value":"Mihaela Vorvoreanu","user_id":36804,"rest_url":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/microsoft-research\/v1\/researchers?person=Mihaela Vorvoreanu"},{"type":"user_nicename","value":"Sida Peng","user_id":37008,"rest_url":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/microsoft-research\/v1\/researchers?person=Sida Peng"},{"type":"user_nicename","value":"Jake Hofman","user_id":32340,"rest_url":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/microsoft-research\/v1\/researchers?person=Jake Hofman"},{"type":"text","value":"Alex Farach","user_id":0,"rest_url":false},{"type":"text","value":"Margarita Bermejo-Cano","user_id":0,"rest_url":false},{"type":"text","value":"Eric Knudsen","user_id":0,"rest_url":false},{"type":"user_nicename","value":"James Bono","user_id":39387,"rest_url":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/microsoft-research\/v1\/researchers?person=James Bono"},{"type":"text","value":"Hardik Sanghavi","user_id":0,"rest_url":false},{"type":"text","value":"Sofia Spatharioti","user_id":0,"rest_url":false},{"type":"user_nicename","value":"David Rothschild","user_id":31566,"rest_url":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/microsoft-research\/v1\/researchers?person=David Rothschild"},{"type":"user_nicename","value":"Dan Goldstein","user_id":31618,"rest_url":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/microsoft-research\/v1\/researchers?person=Dan Goldstein"},{"type":"user_nicename","value":"Eirini Kalliamvakou","user_id":40168,"rest_url":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/microsoft-research\/v1\/researchers?person=Eirini Kalliamvakou"},{"type":"text","value":"Peter Cihon","user_id":0,"rest_url":false},{"type":"guest","value":"mert-demirer","user_id":489503,"rest_url":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/microsoft-research\/v1\/researchers?person=mert-demirer"},{"type":"user_nicename","value":"Michael Schwarz","user_id":37803,"rest_url":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/microsoft-research\/v1\/researchers?person=Michael Schwarz"},{"type":"user_nicename","value":"Jaime Teevan","user_id":33975,"rest_url":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/microsoft-research\/v1\/researchers?person=Jaime Teevan"}],"msr_impact_theme":[],"msr_research_lab":[],"msr_event":[],"msr_group":[643845],"msr_project":[717493],"publication":[],"video":[],"msr-tool":[],"msr_publication_type":"techreport","related_content":{"projects":[{"ID":717493,"post_title":"The New Future of Work","post_name":"the-new-future-of-work","post_type":"msr-project","post_date":"2021-01-25 07:40:51","post_modified":"2026-02-23 14:40:27","post_status":"publish","permalink":"https:\/\/www.microsoft.com\/en-us\/research\/project\/the-new-future-of-work\/","post_excerpt":"This cross-company initiative is dedicated to creating solutions for a future of work that is meaningful, productive, and equitable. The focus has shifted from remote to hybrid to the role of artificial intelligence in changing work practices.","_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/717493"}]}}]},"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-research-item\/989034","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-research-item"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-research-item"}],"version-history":[{"count":5,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-research-item\/989034\/revisions"}],"predecessor-version":[{"id":1063527,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-research-item\/989034\/revisions\/1063527"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=989034"}],"wp:term":[{"taxonomy":"msr-research-highlight","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-research-highlight?post=989034"},{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=989034"},{"taxonomy":"msr-publication-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-publication-type?post=989034"},{"taxonomy":"msr-publisher","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-publisher?post=989034"},{"taxonomy":"msr-focus-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-focus-area?post=989034"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=989034"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=989034"},{"taxonomy":"msr-field-of-study","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-field-of-study?post=989034"},{"taxonomy":"msr-conference","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-conference?post=989034"},{"taxonomy":"msr-journal","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-journal?post=989034"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=989034"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=989034"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}