{"id":676692,"date":"2020-07-23T11:09:10","date_gmt":"2020-07-23T18:09:10","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-academic-program&#038;p=676692"},"modified":"2023-10-04T13:35:20","modified_gmt":"2023-10-04T20:35:20","slug":"mind-news-recommendation-challenge","status":"publish","type":"msr-academic-program","link":"https:\/\/www.microsoft.com\/en-us\/research\/academic-program\/mind-news-recommendation-challenge\/","title":{"rendered":"MIND News Recommendation Challenge"},"content":{"rendered":"\n\n<p><\/p>\n\n\n\n\n\n\n<h2 class=\"wp-block-heading\" id=\"mind-probe-a-competition-on-news-recommendations-with-the-world-s-biggest-news-dataset\">MIND probe: A competition on news recommendations with the world\u2019s biggest news dataset<\/h2>\n\n\n\n<p>Put a battery-operated talking unicorn in your online shopping cart, and you may get an alert suggesting some AA cells to juice up the conversation. Binge-watch a few action movies and you may see titles of martial arts cinema fill up your must-see list.<\/p>\n\n\n\n<p>Recommendation engines try to discern habits, likes, and other affinity traits to anticipate what you may need or want based on past actions. News consumption can fall into these patterns: We know for instance that people go to search engines to find out more about a <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/www.journalism.org\/2017\/02\/09\/part-i-an-analysis-of-individuals-online-news-habits-over-the-course-of-one-week\/\" target=\"_blank\" rel=\"noopener noreferrer\">story<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, be it more background or further developments. Certain types of news and feature stories lend itself to typical user behaviors: An impending hurricane, for instance, triggers preparation research (if you\u2019re in the path), offers of help to donate supplies or blood (if you\u2019re nearby) and historical curiosity of past hurricanes. Even celebrity stories inspire certain common impulses: An engagement announcement will launch some to seek a peek at the ring, others to check out past (failed) relationships.<\/p>\n\n\n\n<p>How might a news recommendation system offer more stories, yet not fall into the trap of filter bubbles and echo chambers? The first thing is, you need a high-quality benchmark dataset. That\u2019s where MIND comes in: a mammoth collection of anonymized data from user behavior logs of about 1 million people. Few companies in the world attract those kinds of numbers, and Microsoft News is one of them.<\/p>\n\n\n\n<p>When you work at the scale that Microsoft News does \u2014 in 140 countries around the world \u2014 the challenge is not to overload its half billion readers. In the not-so-distant past, newspaper print space and radio & TV time constrained how news was reported, displayed and ranked. When the Internet smashed conventions of information delivery, audiences had to assume the responsibility for their own news diet. That diet can be hard to maintain when thousands of news stories come at people every day \u2014 especially when you throw in social media.<\/p>\n\n\n\n<p>And while people want to seek news on their own, they also expect that information relevant to their locality (local news), habits and interests will find their way. The challenge becomes shared amongst the newsroom creators, the distribution channels and the readers.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"let-the-mind-games-begin\">Let the MIND Games begin<\/h2>\n\n\n\n<p>Our data scientists and engineering team behind MIND presented this dataset at the prestigious <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/acl2020.org\/\" target=\"_blank\" rel=\"noopener noreferrer\">Association for Computation Linguistics 2020 conference<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>. There, they covered their white paper, <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/mind-a-large-scale-dataset-for-news-recommendation\/\">MIND: A Large-scale Dataset for News Recommendation<\/a>.<\/p>\n\n\n\n<p>Like all researchers, they\u2019re eager to share: The team has issued a call out to the science world and news publisher to dive into this dataset and come up with ways to rank news articles that align with users\u2019 interests. How might the dataset be used to study the performance of different kinds of models? Might metrics be to evaluate a recommendation\u2019s effectiveness include diversity, \u201cpolitical\u201d balance, a dose of serendipity?<\/p>\n\n\n\n<p>And just to make it interesting, #cashprizes. Grand prize is $10,000, with two second-place prizes at $3,000 and four third-place prizes at $1,000.<\/p>\n\n\n\n<p><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/msnews.github.io\/competition.html\" target=\"_blank\" rel=\"noopener noreferrer\">Competition registration<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> opens July 20, after which participants can download the training dataset to test their algorithms. The actual competition starts August 21, when the real test data will be made available. Technical reports are encouraged but not required, although the winning entries will be published online and presented at a future workshop. The deadline is midnight September 4 (UTC).<\/p>\n\n\n\n<p>The dataset is free to download for research purposes on <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/msnews.github.io\/index.html\" target=\"_blank\" rel=\"noopener noreferrer\">MIND Website<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, and baseline algorithms are available on <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/github.com\/microsoft\/recommenders\" target=\"_blank\" rel=\"noopener noreferrer\">Microsoft Recommenders repository<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>.&nbsp; There are two offerings of the dataset: the whole kit\u2019n\u2019caboodle and a smaller subset of 50,000 users called MIND-small, but the goals the Microsoft data scientists aim to achieve aren\u2019t small-minded at all.<\/p>\n\n\n\n<div class=\"wp-block-buttons is-layout-flex wp-block-buttons-is-layout-flex\">\n<div class=\"wp-block-button\"><a data-bi-type=\"button\" class=\"wp-block-button__link wp-element-button\" href=\"https:\/\/msnews.github.io\/competition.html\">Participate<\/a><\/div>\n<\/div>\n\n\n\n<p><\/p>\n\n\n\n<p><strong>Useful links:<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/msnews.github.io\/#about-mind\" target=\"_blank\" rel=\"noopener noreferrer\">MIND Dataset<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n\n\n\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/github.com\/msnews\/MIND\" target=\"_blank\" rel=\"noopener noreferrer\">MIND Repo<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n\n\n\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/github.com\/microsoft\/recommenders\" target=\"_blank\" rel=\"noopener noreferrer\">Recommenders Repo<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n\n\n\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/github.com\/microsoft\/recommenders\/tree\/master\/scenarios\/news\" target=\"_blank\" rel=\"noopener noreferrer\">Recommendation Systems for News<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<\/ul>\n\n\n\n<p><strong>Contact us:<\/strong><\/p>\n\n\n\n<p>For any inquiries please see our FAQ section or <a href=\"mailto:mind@microsoft.com\">send us an email<\/a>.<\/p>\n\n\n\n\n\n<p><strong>July 20, 2020:<\/strong> Competition is open. Participants registration begins.<br><strong>July 20 \u2013 August 20, 2020:<\/strong> Dev phase. Participants can submit their results on the dev set to obtain official evaluation scores.<br><strong>August 21 \u2013 September 4, 2020:<\/strong> Test phase. Test data can be downloaded and participants can submit their results on the test set.<br><strong>September 11, 2020:<\/strong> Competition results announcement.<\/p>\n\n\n\n<p><em>*All deadlines are at 11:59 PM UTC on the corresponding day.<\/em><\/p>\n\n\n\n\n\n<p>Within 7 days following the Entry Period one Grand, two Second Place and four Third Place participants will be selected from among all eligible entries received.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Grand Prize: The winner will receive US $10,000.<\/li>\n\n\n\n<li>Second Place Prizes: Each winner will receive US $3,000.<\/li>\n\n\n\n<li>Third Place Prizes: Each winner will receive US $1,000.<\/li>\n<\/ul>\n\n\n\n<p>In addition, we invite each winner to submit a system description paper and present your work after the end of the competition (other participants\u2019 submissions are also highly encouraged).<\/p>\n\n\n\n\n\n<h2 class=\"wp-block-heading\" id=\"who-is-behind-this-competition\">Who is behind this competition?<\/h2>\n\n\n\n<p>This competition is collaboratively organized by <a href=\"https:\/\/www.microsoft.com\/en-us\/microsoftnews\" target=\"_blank\" rel=\"noopener\">Microsoft News<\/a> and <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/lab\/microsoft-research-asia\/\">Microsoft Research Asia<\/a> teams.<\/p>\n\n\n\n<p>Many people are helping to make this happen, but the core team consists of:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/www.linkedin.com\/in\/ying-qiao-15ab4716\/\" target=\"_blank\" rel=\"noopener noreferrer\">Ying Qiao<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/www.linkedin.com\/in\/jiun-hung-chen-999a3715b\/\" target=\"_blank\" rel=\"noopener noreferrer\">Jiun-Hung Chen<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/www.linkedin.com\/in\/winnie-wu-b471487a\/\" target=\"_blank\" rel=\"noopener noreferrer\">Winnie Wu<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> (Microsoft News Team)<\/li>\n\n\n\n<li><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/fangzwu\/\">Fangzhao Wu<\/a>, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/academic.microsoft.com\/author\/2772180723\/\" target=\"_blank\" rel=\"noopener noreferrer\">Chuhan Wu<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/academic.microsoft.com\/author\/2954263209\/\" target=\"_blank\" rel=\"noopener noreferrer\">Tao Qi<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, Jingwei Yi, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/academic.microsoft.com\/author\/2808005713\/\" target=\"_blank\" rel=\"noopener noreferrer\">Ling Luo<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>,&nbsp;Lei Yu, <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/xingx\/\">Xing Xie<\/a> (Microsoft Research Asia)<\/li>\n<\/ul>\n\n\n\n<p>For any inquiries please see our FAQ section or&nbsp;<a href=\"mailto:mind@microsoft.com?subject=[FAQ\/Team%5d\">send us an email<\/a>.<\/p>\n\n\n\n\n\n<p>Before you participate in the competition, please read the&nbsp;<a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/github.com\/msnews\/MIND\/blob\/master\/MICROSOFT%20MIND%20NEWS%20RECOMMENDATION%20CONTEST.pdf\" target=\"_blank\" rel=\"noopener noreferrer\">rules<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>&nbsp;of this competition and confirm that you agree to them (you need to send your agreement in your registration email). In addition, the MIND dataset is free to download for research purposes under&nbsp;<a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/github.com\/msnews\/MIND\/blob\/master\/MSR%20License_Data.pdf\" target=\"_blank\" rel=\"noopener noreferrer\">Microsoft Research License Terms<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>. Please read these terms and confirm that you agree to them before you download the dataset. Feel free to contact us if you have any questions or need clarification regarding the rules of this competition or the licensing of the data.<\/p>\n\n\n\n\n\n<p>Go to our <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/msnews.github.io\/competition.html\" target=\"_blank\" rel=\"noopener noreferrer\">competition page<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> and click \u201cJoin Competition\u201d. You will be directed to the CodaLab platform. From there, please follow the detailed steps under the \u201cOverview\u201d tab on the CodaLab competition page.<\/p>\n\n\n\n\n\n<p>Please follow the detailed steps under the \u201cSubmission Guidelines\u201d tab on the <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/msnews.github.io\/competition.html\" target=\"_blank\" rel=\"noopener noreferrer\">competition page<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>. We may update details throughout the development and final test phases.<\/p>\n\n\n\n\n\n<p>Please find more info on our <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/msnews.github.io\/#about-mind\" target=\"_blank\" rel=\"noopener noreferrer\">dataset website<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>. You can find a smaller dataset for trial, and you can download the evaluation script here:&nbsp;<a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/github.com\/msnews\/MIND\/blob\/master\/evaluate.py\" target=\"_blank\" rel=\"noopener noreferrer\">evaluation.py<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/p>\n\n\n\n\n\n<p>Yes, we encourage academic publications relating to the dataset and competition. If you do decide to publish results, please cite MIND as:<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">@inproceedings{wu-etal-2020-mind,<\/pre>\n\n\n\n<pre class=\"wp-block-preformatted\">title = \"{MIND}: A Large-scale Dataset for News Recommendation\",<\/pre>\n\n\n\n<pre class=\"wp-block-preformatted\">author = \"Wu, Fangzhao&nbsp;and Qiao, Ying&nbsp;and Chen, Jiun-Hung and&nbsp;Wu, Chuhan and Qi, Tao and Lian, Jianxun and Liu, Danyang and Xie, Xing and&nbsp;Gao, Jianfeng and Wu, Winnie and Zhou, Ming\",<\/pre>\n\n\n\n<pre class=\"wp-block-preformatted\">booktitle = \"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics\",<\/pre>\n\n\n\n<pre class=\"wp-block-preformatted\">month = jul,<\/pre>\n\n\n\n<pre class=\"wp-block-preformatted\">year = \"2020\",<\/pre>\n\n\n\n<pre class=\"wp-block-preformatted\">address = \"Online\",<\/pre>\n\n\n\n<pre class=\"wp-block-preformatted\">publisher = \"Association for Computational Linguistics\",<\/pre>\n\n\n\n<pre class=\"wp-block-preformatted\">url = \"https:\/\/www.aclweb.org\/anthology\/2020.acl-main.331\",<\/pre>\n\n\n\n<pre class=\"wp-block-preformatted\">pages = \"3597--3606\",<\/pre>\n\n\n\n<pre class=\"wp-block-preformatted\">}<\/pre>\n\n\n\n\n\n<p>For any inquiries please see our FAQ section or&nbsp;<a href=\"mailto:mind@microsoft.com?subject=[FAQ]\">send us an email<\/a>.<\/p>\n\n\n\n\n","protected":false},"featured_media":677166,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","msr_hide_image_in_river":0,"footnotes":""},"msr-opportunity-type":[187426],"msr-region":[256048],"msr-locale":[268875],"msr-program-audience":[],"msr-post-option":[],"msr-impact-theme":[],"class_list":["post-676692","msr-academic-program","type-msr-academic-program","status-publish","has-post-thumbnail","hentry","msr-opportunity-type-challenges","msr-region-global","msr-locale-en_us"],"msr_description":"Microsoft is holding a MIND News Recommendation Competition based on the MIND dataset, a large-scale English dataset for news recommendation. This challenge provides a testbed for participants to develop better news recommender systems to improve the future reading experience of millions of users.","msr_social_media":[],"related-researchers":[],"tab-content":[{"id":0,"name":"About","content":"<h2>MIND probe: A competition on news recommendations with the world\u2019s biggest news dataset<\/h2>\r\nPut a battery-operated talking unicorn in your online shopping cart, and you may get an alert suggesting some AA cells to juice up the conversation. Binge-watch a few action movies and you may see titles of martial arts cinema fill up your must-see list.\r\n\r\nRecommendation engines try to discern habits, likes, and other affinity traits to anticipate what you may need or want based on past actions. News consumption can fall into these patterns: We know for instance that people go to search engines to find out more about a <a href=\"https:\/\/www.journalism.org\/2017\/02\/09\/part-i-an-analysis-of-individuals-online-news-habits-over-the-course-of-one-week\/\" target=\"_blank\" rel=\"noopener\">story<\/a>, be it more background or further developments. Certain types of news and feature stories lend itself to typical user behaviors: An impending hurricane, for instance, triggers preparation research (if you're in the path), offers of help to donate supplies or blood (if you're nearby) and historical curiosity of past hurricanes. Even celebrity stories inspire certain common impulses: An engagement announcement will launch some to seek a peek at the ring, others to check out past (failed) relationships.\r\n\r\nHow might a news recommendation system offer more stories, yet not fall into the trap of filter bubbles and echo chambers? The first thing is, you need a high-quality benchmark dataset. That's where MIND comes in: a mammoth collection of anonymized data from user behavior logs of about 1 million people. Few companies in the world attract those kinds of numbers, and Microsoft News is one of them.\r\n\r\nWhen you work at the scale that Microsoft News does -- in 140 countries around the world -- the challenge is not to overload its half billion readers. In the not-so-distant past, newspaper print space and radio &amp; TV time constrained how news was reported, displayed and ranked. When the Internet smashed conventions of information delivery, audiences had to assume the responsibility for their own news diet. That diet can be hard to maintain when thousands of news stories come at people every day -- especially when you throw in social media.\r\n\r\nAnd while people want to seek news on their own, they also expect that information relevant to their locality (local news), habits and interests will find their way. The challenge becomes shared amongst the newsroom creators, the distribution channels and the readers.\r\n<h2>Let the MIND Games begin<\/h2>\r\nOur data scientists and engineering team behind MIND presented this dataset at the prestigious <a href=\"https:\/\/acl2020.org\/\" target=\"_blank\" rel=\"noopener\">Association for Computation Linguistics 2020 conference<\/a>. There, they covered their white paper, <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/mind-a-large-scale-dataset-for-news-recommendation\/\">MIND: A Large-scale Dataset for News Recommendation<\/a>.\r\n\r\nLike all researchers, they're eager to share: The team has issued a call out to the science world and news publisher to dive into this dataset and come up with ways to rank news articles that align with users' interests. How might the dataset be used to study the performance of different kinds of models? Might metrics be to evaluate a recommendation\u2019s effectiveness include diversity, \u201cpolitical\u201d balance, a dose of serendipity?\r\n\r\nAnd just to make it interesting, #cashprizes. Grand prize is $10,000, with two second-place prizes at $3,000 and four third-place prizes at $1,000.\r\n\r\n<a href=\"https:\/\/msnews.github.io\/competition.html\" target=\"_blank\" rel=\"noopener\">Competition registration<\/a> opens July 20, after which participants can download the training dataset to test their algorithms. The actual competition starts August 21, when the real test data will be made available. Technical reports are encouraged but not required, although the winning entries will be published online and presented at a future workshop. The deadline is midnight September 4 (UTC).\r\n\r\nThe dataset is free to download for research purposes on <a href=\"https:\/\/msnews.github.io\/index.html\" target=\"_blank\" rel=\"noopener\">MIND Website<\/a>, and baseline algorithms are available on <a href=\"https:\/\/github.com\/microsoft\/recommenders\" target=\"_blank\" rel=\"noopener\">Microsoft Recommenders repository<\/a>.\u00a0 There are two offerings of the dataset: the whole kit\u2019n\u2019caboodle and a smaller subset of 50,000 users called MIND-small, but the goals the Microsoft data scientists aim to achieve aren't small-minded at all."},{"id":1,"name":"Timeline","content":"<strong>July 20, 2020:<\/strong> Competition is open. Participants registration begins.\r\n<strong>July 20 - August 20, 2020:<\/strong> Dev phase. Participants can submit their results on the dev set to obtain official evaluation scores.\r\n<strong>August 21 - September 4, 2020:<\/strong> Test phase. Test data can be downloaded and participants can submit their results on the test set.\r\n<strong>September 11, 2020:<\/strong> Competition results announcement.\r\n\r\n<em>*All deadlines are at 11:59 PM UTC on the corresponding day.<\/em>"},{"id":2,"name":"Prizes","content":"Within 7 days following the Entry Period one Grand, two Second Place and four Third Place participants will be selected from among all eligible entries received.\r\n<ul>\r\n \t<li>Grand Prize: The winner will receive US $10,000.<\/li>\r\n \t<li>Second Place Prizes: Each winner will receive US $3,000.<\/li>\r\n \t<li>Third Place Prizes: Each winner will receive US $1,000.<\/li>\r\n<\/ul>\r\nIn addition, we invite each winner to submit a system description paper and present your work after the end of the competition (other participants' submissions are also highly encouraged)."},{"id":3,"name":"Organizing team","content":"<h2>Who is behind this competition?<\/h2>\r\nThis competition is collaboratively organized by <a href=\"https:\/\/www.microsoft.com\/en-us\/microsoftnews\" target=\"_blank\" rel=\"noopener\">Microsoft News<\/a> and <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/lab\/microsoft-research-asia\/\">Microsoft Research Asia<\/a> teams.\r\n\r\nMany people are helping to make this happen, but the core team consists of:\r\n<ul>\r\n \t<li><a href=\"https:\/\/www.linkedin.com\/in\/ying-qiao-15ab4716\/\" target=\"_blank\" rel=\"noopener\">Ying Qiao<\/a>, <a href=\"https:\/\/www.linkedin.com\/in\/jiun-hung-chen-999a3715b\/\" target=\"_blank\" rel=\"noopener\">Jiun-Hung Chen<\/a>, <a href=\"https:\/\/www.linkedin.com\/in\/winnie-wu-b471487a\/\" target=\"_blank\" rel=\"noopener\">Winnie Wu<\/a> (Microsoft News Team)<\/li>\r\n \t<li><a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/fangzwu\/\">Fangzhao Wu<\/a>, <a href=\"https:\/\/academic.microsoft.com\/author\/2772180723\/\" target=\"_blank\" rel=\"noopener\">Chuhan Wu<\/a>, <a href=\"https:\/\/academic.microsoft.com\/author\/2954263209\/\" target=\"_blank\" rel=\"noopener\">Tao Qi<\/a>, Jingwei Yi, <a href=\"https:\/\/academic.microsoft.com\/author\/2808005713\/\" target=\"_blank\" rel=\"noopener\">Ling Luo<\/a>,\u00a0Lei Yu, <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/xingx\/\">Xing Xie<\/a> (Microsoft Research Asia)<\/li>\r\n<\/ul>\r\nFor any inquiries please see our FAQ section or\u00a0<a href=\"mailto:mind@microsoft.com?subject=[FAQ\/Team%5d\">send us an email<\/a>."},{"id":4,"name":"FAQ","content":"Before you participate in the competition, please read the\u00a0<a href=\"https:\/\/github.com\/msnews\/MIND\/blob\/master\/MICROSOFT%20MIND%20NEWS%20RECOMMENDATION%20CONTEST.pdf\" target=\"_blank\" rel=\"noopener\">rules<\/a>\u00a0of this competition and confirm that you agree to them (you need to send your agreement in your registration email). In addition, the MIND dataset is free to download for research purposes under\u00a0<a href=\"https:\/\/github.com\/msnews\/MIND\/blob\/master\/MSR%20License_Data.pdf\" target=\"_blank\" rel=\"noopener\">Microsoft Research License Terms<\/a>. Please read these terms and confirm that you agree to them before you download the dataset. Feel free to contact us if you have any questions or need clarification regarding the rules of this competition or the licensing of the data.\r\n\r\n[accordion]\r\n\r\n[panel header=\"How do I participate?\"]\r\n\r\nGo to our <a href=\"https:\/\/msnews.github.io\/competition.html\" target=\"_blank\" rel=\"noopener\">competition page<\/a> and click \u201cJoin Competition\u201d. You will be directed to the CodaLab platform. From there, please follow the detailed steps under the \u201cOverview\u201d tab on the CodaLab competition page.\r\n\r\n[\/panel]\r\n\r\n[panel header=\"How do I submit my entry to the competition?\"]\r\n\r\nPlease follow the detailed steps under the \u201cSubmission Guidelines\u201d tab on the <a href=\"https:\/\/msnews.github.io\/competition.html\" target=\"_blank\" rel=\"noopener\">competition page<\/a>. We may update details throughout the development and final test phases.\r\n\r\n[\/panel]\r\n\r\n[panel header=\"Do you have some example code or a smaller dataset for trial?\"]\r\n\r\nPlease find more info on our <a href=\"https:\/\/msnews.github.io\/#about-mind\" target=\"_blank\" rel=\"noopener\">dataset website<\/a>. You can find a smaller dataset for trial, and you can download the evaluation script here:\u00a0<a href=\"https:\/\/github.com\/msnews\/MIND\/blob\/master\/evaluate.py\" target=\"_blank\" rel=\"noopener\">evaluation.py<\/a>\r\n\r\n[\/panel]\r\n\r\n[panel header=\"Can I publish results of my experiments?\"]\r\n\r\nYes, we encourage academic publications relating to the dataset and competition. If you do decide to publish results, please cite MIND as:\r\n<pre>@inproceedings{wu-etal-2020-mind,<\/pre>\r\n<pre style=\"padding-left: 30px\">title = \"{MIND}: A Large-scale Dataset for News Recommendation\",<\/pre>\r\n<pre style=\"padding-left: 30px\">author = \"Wu, Fangzhao\u00a0and Qiao, Ying\u00a0and Chen, Jiun-Hung and\u00a0Wu, Chuhan and Qi, Tao and Lian, Jianxun and Liu, Danyang and Xie, Xing and\u00a0Gao, Jianfeng and Wu, Winnie and Zhou, Ming\",<\/pre>\r\n<pre style=\"padding-left: 30px\">booktitle = \"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics\",<\/pre>\r\n<pre style=\"padding-left: 30px\">month = jul,<\/pre>\r\n<pre style=\"padding-left: 30px\">year = \"2020\",<\/pre>\r\n<pre style=\"padding-left: 30px\">address = \"Online\",<\/pre>\r\n<pre style=\"padding-left: 30px\">publisher = \"Association for Computational Linguistics\",<\/pre>\r\n<pre style=\"padding-left: 30px\">url = \"https:\/\/www.aclweb.org\/anthology\/2020.acl-main.331\",<\/pre>\r\n<pre style=\"padding-left: 30px\">pages = \"3597--3606\",<\/pre>\r\n<pre>}<\/pre>\r\n[\/panel]\r\n\r\n[panel header=\"Where can I get help?\"]\r\n\r\nFor any inquiries please see our FAQ section or\u00a0<a href=\"mailto:mind@microsoft.com?subject=[FAQ]\">send us an email<\/a>.\r\n\r\n[\/panel]\r\n\r\n[\/accordion]"}],"msr_impact_theme":[],"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-academic-program\/676692","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-academic-program"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-academic-program"}],"version-history":[{"count":13,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-academic-program\/676692\/revisions"}],"predecessor-version":[{"id":972906,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-academic-program\/676692\/revisions\/972906"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/677166"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=676692"}],"wp:term":[{"taxonomy":"msr-opportunity-type","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-opportunity-type?post=676692"},{"taxonomy":"msr-region","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-region?post=676692"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=676692"},{"taxonomy":"msr-program-audience","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-program-audience?post=676692"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=676692"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=676692"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}