{"id":171314,"date":"2014-03-21T14:26:11","date_gmt":"2014-03-21T14:26:11","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/project\/codalab\/"},"modified":"2019-08-19T14:32:28","modified_gmt":"2019-08-19T21:32:28","slug":"codalab","status":"publish","type":"msr-project","link":"https:\/\/www.microsoft.com\/en-us\/research\/project\/codalab\/","title":{"rendered":"CodaLab"},"content":{"rendered":"<p>CodaLab is an open-source web-based platform that enables researchers, developers, and data scientists to collaborate, with the goal of advancing research fields where machine learning and advanced computation is used. CodaLab helps solve many common problems in the arena of data-oriented research through its online community, where people share worksheets and participate in collaborative competitions.<\/p>\n<h2>Immutable experimentation that ensures reproducibility<\/h2>\n<p>Today\u2019s data-driven research and development is stymied by an inability of scientists and their collaborators to easily reproduce and augment one another\u2019s experiments. CodaLab addresses this problem by providing a cloud-based virtual \u201cworkbench,\u201d where computer scientists can conduct data-driven experiments quickly and easily.<\/p>\n<p>Experiments can then be easily copied, reworked, and edited by other collaborators in order to advance the state-of-the-art in data-driven research and machine learning. Conferences such as ACL 2016 encourage the use of CodaLab Worksheets for submission of software resources with papers. Do you want to share your research and accelerate the path of innovation?<\/p>\n<p><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/worksheets.codalab.org\/\" target=\"_blank\" rel=\"noopener noreferrer\">Try CodaLab Worksheets now<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>\u00a0><\/p>\n<h2>Collaboration that drives innovation<\/h2>\n<p>By working with the data-driven research community, we have enhanced the ability of scientists and engineers to organize and host competitions in which participants can collaborate with one another to deliver the best solutions for some of their most challenging problems.<\/p>\n<p><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/competitions.codalab.org\/\" target=\"_blank\" rel=\"noopener noreferrer\">Try CodaLab Competitions\u00a0now<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>\u00a0><\/p>\n<blockquote><p><strong>Want to further develop CodaLab?<\/strong><br \/>\nContribute to this open-source platform on <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/github.com\/codalab\" target=\"_blank\" rel=\"noopener noreferrer\">GitHub<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>\u00a0><\/p><\/blockquote>\n<h2>Community partners<\/h2>\n<p>CodaLab&#8217;s community leaders include <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"http:\/\/cs.stanford.edu\/~pliang\/\" target=\"_blank\" rel=\"noopener noreferrer\">Percy Liang<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, of <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"http:\/\/www.stanford.edu\/\" target=\"_blank\" rel=\"noopener noreferrer\">Stanford University<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, who focuses on <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"http:\/\/worksheets.codalab.org\/\" target=\"_blank\" rel=\"noopener noreferrer\">CodaLab Worksheets<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>; <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"http:\/\/www.clopinet.com\/isabelle\/\" target=\"_blank\" rel=\"noopener noreferrer\">Isabelle Guyon<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, of <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"http:\/\/universite-paris-saclay.fr\/en\" target=\"_blank\" rel=\"noopener noreferrer\">University of Paris-Saclay<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> and <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"http:\/\/chalearn.org\/\" target=\"_blank\" rel=\"noopener noreferrer\">ChaLearn<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, who focuses on <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/competitions.codalab.org\/\" target=\"_blank\" rel=\"noopener noreferrer\">CodaLab Competitions<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>; and <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"http:\/\/sergioescalera.com\/\" target=\"_blank\" rel=\"noopener noreferrer\">Sergio Escalera<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, of the <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"http:\/\/www.uab.cat\/\" target=\"_blank\" rel=\"noopener noreferrer\">Autonomous University of Barcelona<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>.<\/p>\n<h2>Acknowledgments<\/h2>\n<p>CodaLab has received important contributions from many people, and we would like to thank them for their efforts in making CodaLab what it is today:<\/p>\n<p>Pujun Bhatnagar, Eric Carmichael, Justin Carden, Richard Caruana, Francis Cleary, Sergio Escalera, Ivan Judson, Lori Ada Kilty, Shaunak Kishore, Stephen Koo, Pragnya Maduskar, Simon Mercer, Arthur Pesah, <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/cpoulain\/\" target=\"_blank\" rel=\"noopener noreferrer\">Christophe Poulain<\/a>, Lukasz Romaszko, Xavier Baro Sole, Paul Viola, Erick Watson, Tony Yang, Flavio Zhingri, Michael Zyskowski.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>CodaLab is an open-source web-based platform that enables researchers, developers, and data scientists to collaborate, with the goal of advancing research fields where machine learning and advanced computation is used. CodaLab helps solve many common problems in the arena of data-oriented research through its online community, where people share worksheets and participate in collaborative competitions. [&hellip;]<\/p>\n","protected":false},"featured_media":236051,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","footnotes":""},"research-area":[13556,13562,13545],"msr-locale":[268875],"msr-impact-theme":[],"msr-pillar":[],"class_list":["post-171314","msr-project","type-msr-project","status-publish","has-post-thumbnail","hentry","msr-research-area-artificial-intelligence","msr-research-area-computer-vision","msr-research-area-human-language-technologies","msr-locale-en_us","msr-archive-status-active"],"msr_project_start":"2014-03-21","related-publications":[],"related-downloads":[],"related-videos":[191118,191185],"related-groups":[],"related-events":[],"related-opportunities":[],"related-posts":[],"related-articles":[],"tab-content":[{"id":0,"name":"Events","content":"<ul>\r\n \t<li><a href=\"http:\/\/acl2016.org\/index.php?article_id=9\" target=\"_blank\" rel=\"noopener noreferrer\">ACL 2016 endorses CodaLab<\/a> to enable reproducible research<\/li>\r\n \t<li><a href=\"https:\/\/youtu.be\/mU1yEEMrMvY\" target=\"_blank\" rel=\"noopener noreferrer\">VIDEO: Introducing CodaLab Competitions<\/a><\/li>\r\n \t<li><a href=\"http:\/\/ciml.chalearn.org\/home\" target=\"_blank\" rel=\"noopener noreferrer\">Challenges in Machine Learning workshop (CiML 2015)<\/a>, colocated with NIPS 2015<\/li>\r\n \t<li><a href=\"http:\/\/ciml.chalearn.org\/ciml-2014\" target=\"_blank\" rel=\"noopener noreferrer\">Challenges in Machine Learning workshop (CiML 2014)<\/a>, colocated with NIPS 2014<\/li>\r\n \t<li><a href=\"http:\/\/clopinet.com\/isabelle\/Projects\/NIPS2013\/\" target=\"_blank\" rel=\"noopener noreferrer\">Causality Challenge workshop at NIPS<\/a>, 2013<\/li>\r\n<\/ul>"}],"slides":[],"related-researchers":[],"msr_research_lab":[],"msr_impact_theme":[],"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/171314","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-project"}],"version-history":[{"count":4,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/171314\/revisions"}],"predecessor-version":[{"id":604317,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/171314\/revisions\/604317"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/236051"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=171314"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=171314"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=171314"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=171314"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=171314"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}