{"id":492176,"date":"2018-06-29T13:30:20","date_gmt":"2018-06-29T20:30:20","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-blog-post&#038;p=492176"},"modified":"2018-08-06T12:04:27","modified_gmt":"2018-08-06T19:04:27","slug":"sigir-conference-analytics","status":"publish","type":"msr-blog-post","link":"https:\/\/www.microsoft.com\/en-us\/research\/articles\/sigir-conference-analytics\/","title":{"rendered":"SIGIR Conference Analytics"},"content":{"rendered":"<p>The <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/project\/microsoft-academic-graph\/\">Microsoft Academic Graph<\/a> makes it possible to gain analytic insights about any of the entities within it: publications, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/academic.microsoft.com\/#\/authors\/0\/\" target=\"_blank\" rel=\"noopener noreferrer\">authors<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/academic.microsoft.com\/#\/institutions\/0\/\" target=\"_blank\" rel=\"noopener noreferrer\">institutions<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/academic.microsoft.com\/#\/topics\/0\/\" target=\"_blank\" rel=\"noopener noreferrer\">topics<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/academic.microsoft.com\/#\/journals\/0\/\" target=\"_blank\" rel=\"noopener noreferrer\">journals<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, and <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/academic.microsoft.com\/#\/conferences\/0\/\" target=\"_blank\" rel=\"noopener noreferrer\">conferences<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>. In this series, we present analytic insights about current conferences, which we hope will help you prepare for attending each event. All the insights within are derived from the Microsoft Academic Graph and visualized in Microsoft Power BI. You can generate your own insights by accessing the Microsoft Academic Graph through the <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/labs.cognitive.microsoft.com\/en-us\/project-academic-knowledge\" target=\"_blank\" rel=\"noopener noreferrer\">Academic Knowledge API<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> or through <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/azure.microsoft.com\/en-us\/services\/data-lake-store\/\" target=\"_blank\" rel=\"noopener noreferrer\">Azure Data Lake Store<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> (please <a href=\"mailto:academicapi@microsoft.com\">contact us<\/a> for the latter option). If you would like to learn how we generated the insights below, please see the <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/github.com\/Azure-Samples\/academic-knowledge-analytics-visualization\" target=\"_blank\" rel=\"noopener noreferrer\">repository with source code<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>.<\/p>\n<p>In this post, we present historical trend analysis about the conference <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"http:\/\/sigir.org\/sigir2018\/\" target=\"_blank\" rel=\"noopener noreferrer\">SIGIR &#8211; Special Interest Group on Information Retrieval<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, taking place in Ann Arbor, Michigan, US. from July 8-12, 2018.<\/p>\n<p><em>Click on each image for current trends and data hosted by <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/project\/microsoft-academic-graph\/\" target=\"_blank\" rel=\"noopener\">Microsoft Academic Graph<\/a>.<\/em><\/p>\n<h2>SIGIR paper output<\/h2>\n<p>The chart below shows the evolution of the number of conference papers for each conference year.<\/p>\n<p><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/msit.powerbi.com\/view?r=eyJrIjoiOTc3ZGY0NDEtM2QwMy00MGVmLWExODgtZTk1YWVmYzNmYzNkIiwidCI6IjcyZjk4OGJmLTg2ZjEtNDFhZi05MWFiLTJkN2NkMDExZGI0NyIsImMiOjV9&pageName=ReportSection\" target=\"_blank\" rel=\"noopener noreferrer\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-492926 size-large\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/1-5b341f6a20917-1024x594.jpg\" alt=\"SIGIR Analytics\" width=\"1024\" height=\"594\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/1-5b341f6a20917-1024x594.jpg 1024w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/1-5b341f6a20917-300x174.jpg 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/1-5b341f6a20917-768x445.jpg 768w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/1-5b341f6a20917.jpg 1801w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/p>\n<p>In the following chart, the black bars represent average numbers of references per conference paper for each year. The data show that recent publications tend to cite more references. The green bars show the average number of citations of conference papers written in a given year. Note that the citations are raw counts and not normalized by the age of publications. This is because the \u201ccorrect\u201d way to normalize the citation counts turns out to be a nontrivial problem and may well be application dependent. Please treat the raw data presented as an invitation to conduct research on this topic!<\/p>\n<p><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/msit.powerbi.com\/view?r=eyJrIjoiOTc3ZGY0NDEtM2QwMy00MGVmLWExODgtZTk1YWVmYzNmYzNkIiwidCI6IjcyZjk4OGJmLTg2ZjEtNDFhZi05MWFiLTJkN2NkMDExZGI0NyIsImMiOjV9&pageName=ReportSection64300c408074167a6155\" target=\"_blank\" rel=\"noopener noreferrer\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-492932 size-large\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/2-5b341fecb9887-1024x583.jpg\" alt=\"\" width=\"1024\" height=\"583\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/2-5b341fecb9887-1024x583.jpg 1024w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/2-5b341fecb9887-300x171.jpg 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/2-5b341fecb9887-768x437.jpg 768w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/2-5b341fecb9887.jpg 1808w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/p>\n<p>That being said, a visible trend is that older publications tend to receive more citations because they have more time for researchers to recognize the contributions of the paper. There are, however, notable exceptions, the first in 1994, due to several highly cited papers:<\/p>\n<ul>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/academic.microsoft.com\/#\/detail\/2085989833\" target=\"_blank\" rel=\"noopener noreferrer\">David D. Lewis, William A. Gale \u201cA sequential algorithm for training text classifiers.\u201d<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/academic.microsoft.com\/#\/detail\/2014415866\" target=\"_blank\" rel=\"noopener noreferrer\">Stephen E. Robertson, Steve Walker \u201cSome simple effective approximations to the 2-Poisson model for probabilistic weighted retrieval.\u201d<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/academic.microsoft.com\/#\/detail\/2105106523\" target=\"_blank\" rel=\"noopener noreferrer\">Ellen M. Voorhees \u201cQuery expansion using lexical-semantic relations\u201d<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<\/ul>\n<p>The second result, in 1998 and 1999, sees the technique of language model for information retrieval being introduced, leading quite a few papers to be highly cited in the ensuing years. However, in 2000, when the concept of discounted cumulative gain (DCG) is first proposed, most citations of the work go to the journal version (TOIS) of the work published two years later. That might explain why there is a deep decline in the citation counts of SIGIR 2000 relative to adjacent years.<\/p>\n<h2>Memory of references<\/h2>\n<p>How old are the papers cited by SIGIR papers? Follow a given year\u2019s column to see the age of papers cited in conference papers published that year. For example, in 2017, SIGIR papers collectively cited 683 papers published in 2016, 657 papers published in 2015, and so on.<\/p>\n<p><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/msit.powerbi.com\/view?r=eyJrIjoiOTc3ZGY0NDEtM2QwMy00MGVmLWExODgtZTk1YWVmYzNmYzNkIiwidCI6IjcyZjk4OGJmLTg2ZjEtNDFhZi05MWFiLTJkN2NkMDExZGI0NyIsImMiOjV9&pageName=ReportSection5aa6788f30dda3c4e571\" target=\"_blank\" rel=\"noopener noreferrer\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-491648 size-large\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/3-1024x526.jpg\" alt=\"\" width=\"1024\" height=\"526\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/3-1024x526.jpg 1024w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/3-300x154.jpg 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/3-768x394.jpg 768w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/3.jpg 1461w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/p>\n<p><em>*If some years appear to cite publications from the future, it is most likely because they cited books. When a new edition of the book appeared, it replaced the previous one in the Microsoft Academic Graph and the citation appears to be from the future. In this representation, to generate a cleaner view, we removed all instances of papers citing papers more than two years in the future.<\/em><\/p>\n<h2>Outgoing references<\/h2>\n<p>What venues do SIGIR papers cite?<\/p>\n<p>The pie chart shows the top 10 venues cited by\u00a0SIGIR papers over time.\u00a0SIGIR, CIKM, and WWW emerge as the top three.<\/p>\n<p><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/msit.powerbi.com\/view?r=eyJrIjoiOTc3ZGY0NDEtM2QwMy00MGVmLWExODgtZTk1YWVmYzNmYzNkIiwidCI6IjcyZjk4OGJmLTg2ZjEtNDFhZi05MWFiLTJkN2NkMDExZGI0NyIsImMiOjV9&pageName=ReportSection877cd069ea401bcc0b78\" target=\"_blank\" rel=\"noopener noreferrer\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-492938 size-large\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/3-5b34216b5161e-1024x882.jpg\" alt=\"SIGIR Analytics - Top Referenced Venues\" width=\"1024\" height=\"882\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/3-5b34216b5161e-1024x882.jpg 1024w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/3-5b34216b5161e-300x258.jpg 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/3-5b34216b5161e-768x662.jpg 768w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/3-5b34216b5161e.jpg 1098w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/p>\n<p>The 100 percent stacked bar chart below shows the percent of references given by SIGIR\u00a0papers to each of the top 20 venues, year by year.<\/p>\n<p><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/msit.powerbi.com\/view?r=eyJrIjoiOTc3ZGY0NDEtM2QwMy00MGVmLWExODgtZTk1YWVmYzNmYzNkIiwidCI6IjcyZjk4OGJmLTg2ZjEtNDFhZi05MWFiLTJkN2NkMDExZGI0NyIsImMiOjV9&pageName=ReportSection9e43685ae60ee089bd8d\" target=\"_blank\" rel=\"noopener noreferrer\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-492941 size-large\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/4-5b3421f9a3e73-1024x585.jpg\" alt=\"SIGIR Analytics - Top Venue Reference Over Time\" width=\"1024\" height=\"585\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/4-5b3421f9a3e73-1024x585.jpg 1024w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/4-5b3421f9a3e73-300x171.jpg 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/4-5b3421f9a3e73-768x439.jpg 768w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/4-5b3421f9a3e73.jpg 1808w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/p>\n<h2>Incoming citations<\/h2>\n<p>What venues cite SIGIR papers?<\/p>\n<p>The pie chart below shows the top 10 venues of all time that cite SIGIR papers.\u00a0 SIGIR is the top one, followed by CIKM, and Information Processing and Management. See the table for year-by-year details of citations coming from each of the top 10 venues.<\/p>\n<p><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/msit.powerbi.com\/view?r=eyJrIjoiOTc3ZGY0NDEtM2QwMy00MGVmLWExODgtZTk1YWVmYzNmYzNkIiwidCI6IjcyZjk4OGJmLTg2ZjEtNDFhZi05MWFiLTJkN2NkMDExZGI0NyIsImMiOjV9&pageName=ReportSection28f59f85bd62a0050642\" target=\"_blank\" rel=\"noopener noreferrer\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-492944 size-large\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/5-5b34224942898-1024x813.jpg\" alt=\"SIGIR Analytics - Top Citing Venues\" width=\"1024\" height=\"813\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/5-5b34224942898-1024x813.jpg 1024w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/5-5b34224942898-300x238.jpg 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/5-5b34224942898-768x610.jpg 768w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/5-5b34224942898.jpg 1184w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/p>\n<p>The 100 percent stacked bar chart below shows the citation distribution from the top 20 citing venues, year by year.<\/p>\n<p><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/msit.powerbi.com\/view?r=eyJrIjoiOTc3ZGY0NDEtM2QwMy00MGVmLWExODgtZTk1YWVmYzNmYzNkIiwidCI6IjcyZjk4OGJmLTg2ZjEtNDFhZi05MWFiLTJkN2NkMDExZGI0NyIsImMiOjV9&pageName=ReportSection94444bc9501c90220d25\" target=\"_blank\" rel=\"noopener noreferrer\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-492947 size-large\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/6-5b3422dd1f418-1024x583.jpg\" alt=\"SIGIR Analytics - Top venues citations over time\" width=\"1024\" height=\"583\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/6-5b3422dd1f418-1024x583.jpg 1024w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/6-5b3422dd1f418-300x171.jpg 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/6-5b3422dd1f418-768x437.jpg 768w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/6-5b3422dd1f418.jpg 1813w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/p>\n<h2>Most-cited authors<\/h2>\n<p>Who are the most-cited authors of all time in SIGIR papers? The interactive chart below ranks the most-cited authors by using number of publications cited by the conference and number of citations received from the conference. Authors do not have to have published in SIGIR to appear on this chart.<\/p>\n<p><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/msit.powerbi.com\/view?r=eyJrIjoiOTc3ZGY0NDEtM2QwMy00MGVmLWExODgtZTk1YWVmYzNmYzNkIiwidCI6IjcyZjk4OGJmLTg2ZjEtNDFhZi05MWFiLTJkN2NkMDExZGI0NyIsImMiOjV9&pageName=ReportSection040b54e3b60130152e09\" target=\"_blank\" rel=\"noopener noreferrer\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-492950 size-full\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/7-5b342339bf8d7.jpg\" alt=\"SIGIR Analytics - Most-cited authors\" width=\"653\" height=\"482\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/7-5b342339bf8d7.jpg 653w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/7-5b342339bf8d7-300x221.jpg 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/7-5b342339bf8d7-80x60.jpg 80w\" sizes=\"auto, (max-width: 653px) 100vw, 653px\" \/><span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/p>\n<p>Who are the rising stars among the top cited authors in SIGIR? The 100 percent stacked bar chart below shows the citation distribution by the top 20 authors, year by year.<\/p>\n<p><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/msit.powerbi.com\/view?r=eyJrIjoiOTc3ZGY0NDEtM2QwMy00MGVmLWExODgtZTk1YWVmYzNmYzNkIiwidCI6IjcyZjk4OGJmLTg2ZjEtNDFhZi05MWFiLTJkN2NkMDExZGI0NyIsImMiOjV9&pageName=ReportSection1bca5b290bd7905a3072\" target=\"_blank\" rel=\"noopener noreferrer\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-491666 size-large\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/9-1024x581.jpg\" alt=\"\" width=\"1024\" height=\"581\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/9-1024x581.jpg 1024w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/9-300x170.jpg 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/9-768x435.jpg 768w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/9.jpg 1806w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/p>\n<h2>Top institutions<\/h2>\n<p>The bubble chart visualizes the top institutions at SIGIR by citation count. The size of the bubble is proportional to the total number of publications from that institution at SIGIR.<\/p>\n<p><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/msit.powerbi.com\/view?r=eyJrIjoiOTc3ZGY0NDEtM2QwMy00MGVmLWExODgtZTk1YWVmYzNmYzNkIiwidCI6IjcyZjk4OGJmLTg2ZjEtNDFhZi05MWFiLTJkN2NkMDExZGI0NyIsImMiOjV9&pageName=ReportSection4fd5e755853297631ae0\" target=\"_blank\" rel=\"noopener noreferrer\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-492953 size-large\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/8-5b34237f1d30f-1024x881.jpg\" alt=\"SIGIR Analytics - Top Institutions\" width=\"1024\" height=\"881\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/8-5b34237f1d30f-1024x881.jpg 1024w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/8-5b34237f1d30f-300x258.jpg 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/8-5b34237f1d30f-768x661.jpg 768w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/8-5b34237f1d30f.jpg 1060w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/p>\n<p>Get the most current data and also explore the top institutions at the conference in more detail by clicking the chart. Once on the underlying Microsoft PowerBI dashboard, click on a column to rank the top institutions by publication or citation count.<\/p>\n<p><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/msit.powerbi.com\/view?r=eyJrIjoiOTc3ZGY0NDEtM2QwMy00MGVmLWExODgtZTk1YWVmYzNmYzNkIiwidCI6IjcyZjk4OGJmLTg2ZjEtNDFhZi05MWFiLTJkN2NkMDExZGI0NyIsImMiOjV9&pageName=ReportSectioncd55d0220d0d9b53d015\" target=\"_blank\" rel=\"noopener noreferrer\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-492956 size-full\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/9-5b3423bfaf4b7.jpg\" alt=\"SIGIR Analytics - Top institutions\" width=\"673\" height=\"543\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/9-5b3423bfaf4b7.jpg 673w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/9-5b3423bfaf4b7-300x242.jpg 300w\" sizes=\"auto, (max-width: 673px) 100vw, 673px\" \/><span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/p>\n<h2>Top authors<\/h2>\n<p>The next three charts show author rankings according to different criteria.<\/p>\n<p>The bubble chart displays SIGIR authors ranked by citation count, with bubble size being relative to publication count.<\/p>\n<p><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/msit.powerbi.com\/view?r=eyJrIjoiOTc3ZGY0NDEtM2QwMy00MGVmLWExODgtZTk1YWVmYzNmYzNkIiwidCI6IjcyZjk4OGJmLTg2ZjEtNDFhZi05MWFiLTJkN2NkMDExZGI0NyIsImMiOjV9&pageName=ReportSection93ab9db27cc380484980\" target=\"_blank\" rel=\"noopener noreferrer\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-491675 size-large\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/12-1024x831.jpg\" alt=\"SIGIR Conference Analytics - 12\" width=\"1024\" height=\"831\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/12-1024x831.jpg 1024w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/12-300x244.jpg 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/12-768x623.jpg 768w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/12.jpg 1270w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/p>\n<p>Get the most current data and also explore the top authors at the conference in more detail by clicking the chart. Once on the underlying Microsoft PowerBI dashboard, <span style=\"display: inline !important; float: none; background-color: transparent; color: #333333; cursor: text; font-family: Georgia,'Times New Roman','Bitstream Charter',Times,serif; font-size: 16px; font-style: normal; font-variant: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: left; text-decoration: none; text-indent: 0px; text-transform: none; -webkit-text-stroke-width: 0px; white-space: normal; word-spacing: 0px;\">you can also explore the top conference authors in more detail. C<\/span>lick on a column to rank the top authors by <span style=\"display: inline !important; float: none; background-color: transparent; color: #333333; cursor: text; font-family: Georgia,'Times New Roman','Bitstream Charter',Times,serif; font-size: 16px; font-style: normal; font-variant: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: left; text-decoration: none; text-indent: 0px; text-transform: none; -webkit-text-stroke-width: 0px; white-space: normal; word-spacing: 0px;\">Microsoft Academic rank, publication, or citation count.<\/span><\/p>\n<p><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/msit.powerbi.com\/view?r=eyJrIjoiOTc3ZGY0NDEtM2QwMy00MGVmLWExODgtZTk1YWVmYzNmYzNkIiwidCI6IjcyZjk4OGJmLTg2ZjEtNDFhZi05MWFiLTJkN2NkMDExZGI0NyIsImMiOjV9&pageName=ReportSectionc28b3e42437b6370a536\" target=\"_blank\" rel=\"noopener noreferrer\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-491678 size-full\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/13.jpg\" alt=\"SIGIR Conference Analytics - 13\" width=\"736\" height=\"680\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/13.jpg 736w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/13-300x277.jpg 300w\" sizes=\"auto, (max-width: 736px) 100vw, 736px\" \/><span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/p>\n<p>The bubble chart below visualizes author rank, which is calculated by Microsoft Academic by using a formula that is less susceptible to citation counts than similar measures. The X axis shows author rank. The higher an author\u2019s rank, the closer they are to the right side. The Y axis normalizes the rank by publication count and enables us to identify impactful authors who might not have had a very large number of publications. The closer an author is to the top, the higher their normalized rank. Of course, the area of the chart that represents the highest rank is the top right corner.<\/p>\n<p><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/msit.powerbi.com\/view?r=eyJrIjoiOTc3ZGY0NDEtM2QwMy00MGVmLWExODgtZTk1YWVmYzNmYzNkIiwidCI6IjcyZjk4OGJmLTg2ZjEtNDFhZi05MWFiLTJkN2NkMDExZGI0NyIsImMiOjV9&pageName=ReportSectione8aeea536041799471c1\" target=\"_blank\" rel=\"noopener noreferrer\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-491681 size-large\" src=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/14-1024x821.jpg\" alt=\"SIGIR Microsoft Analytics - 14\" width=\"1024\" height=\"821\" srcset=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/14-1024x821.jpg 1024w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/14-300x241.jpg 300w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/14-768x616.jpg 768w, https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2018\/06\/14.jpg 1282w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/p>\n<p>Stephen Roberson is an interesting case. Although he is one of the most influential authors in the information retrieval field, he\u2019s only ranked at the 19<sup>th<\/sup> place for SIGIR conference. It turns out the Stephen\u2019s best work is not published at SIGIR. BM25F is published at CIKM in 2004 [1], then in a booklet in 2009 [2]. He got his fame mostly from Okapi, published first at 1994 TREC [3] through 1999 [4], again, at TREC. His most well-cited work at SIGIR is an approximation to 2-Poisson model [5], and a CAL paper with the Bing team using pseudo-relevance feedback [6] that is no longer in the production. He co-authored a paper questioning the use of language modeling techniques for IR [7] which, unfortunately, prevailed until today against his predictions.<\/p>\n<ol>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/academic.microsoft.com\/#\/detail\/2085030399\" target=\"_blank\" rel=\"noopener noreferrer\">Robertson, Stephen E., et al. \u201cSimple BM25 Extension to Multiple Weighted Fields.\u201d Proceedings of the Thirteenth ACM International Conference on Information and Knowledge Management, 2004, pp. 42\u201349.<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/academic.microsoft.com\/#\/detail\/2155482025\" target=\"_blank\" rel=\"noopener noreferrer\">Robertson, Stephen E., and Hugo Zaragoza. \u201cThe Probabilistic Relevance Framework: BM25 and Beyond.\u201d Foundations and Trends in Information Retrieval, vol. 3, no. 4, 2009, pp. 333\u2013389.<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/academic.microsoft.com\/#\/detail\/1482214997\" target=\"_blank\" rel=\"noopener noreferrer\">Robertson, Stephen E., et al. \u201cOkapi at TREC.\u201d Overview of the Third Text REtrieval Conference, no. 500207, 1994, pp. 109\u2013123.<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/academic.microsoft.com\/#\/detail\/1587004086\" target=\"_blank\" rel=\"noopener noreferrer\">Robertson, Stephen E., and Steve Walker. \u201cOkapi\/Keenbow at TREC-8.\u201d TREC, 1999.<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/academic.microsoft.com\/#\/detail\/2014415866\" target=\"_blank\" rel=\"noopener noreferrer\">Robertson, Stephen E., and Steve Walker. \u201cSome Simple Effective Approximations to the 2-Poisson Model for Probabilistic Weighted Retrieval.\u201d Proceedings of the 17th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 1994, pp. 232\u2013241.<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/academic.microsoft.com\/#\/detail\/2104049510\" target=\"_blank\" rel=\"noopener noreferrer\">Cao, Guihong, et al. \u201cSelecting Good Expansion Terms for Pseudo-Relevance Feedback.\u201d Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2008, pp. 243\u2013250.<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/academic.microsoft.com\/#\/detail\/1997211290\" target=\"_blank\" rel=\"noopener noreferrer\">Allan, James, et al. \u201cChallenges in Information Retrieval and Language Modeling: Report of a Workshop Held at the Center for Intelligent Information Retrieval, University of Massachusetts Amherst, September 2002.\u201d International ACM SIGIR Conference on Research and Development in Information Retrieval, vol. 37, no. 1, 2003, pp. 31\u201347.<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<\/ol>\n<p>We hope you have enjoyed the analytic insights into this conference made possible by the <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/project\/microsoft-academic-graph\/\" target=\"_blank\" rel=\"noopener\">Microsoft Academic Graph<\/a>! Please visit our <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/project\/microsoft-academic-graph\/\" target=\"_blank\" rel=\"noopener\">Microsoft Academic Graph<\/a> page to learn how you can use our knowledge graph to generate your own custom analytics about an institution, a topic, an author, a publication venue, or any combination of these.<\/p>\n<p>As always, we would like to hear from you either through the feedback link at the bottom right of the\u00a0<a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/academic.microsoft.com\/\" target=\"_blank\" rel=\"noopener noreferrer\">website<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> or on\u00a0<a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" href=\"https:\/\/x.com\/msftacademic\" target=\"_blank\" rel=\"noopener noreferrer\">Twitter<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>In this post, we present analytic insights about the conference SIGIR &#8211; Special Interest Group on Information Retrieval, taking place in Ann Arbor Michigan, U.S.A. between July 8-12, 2018. We derive insights since 1993 to the latest available year.<\/p>\n","protected":false},"author":37242,"featured_media":499373,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","msr-content-parent":170262,"msr_hide_image_in_river":0,"footnotes":""},"research-area":[],"msr-locale":[268875],"msr-post-option":[],"class_list":["post-492176","msr-blog-post","type-msr-blog-post","status-publish","has-post-thumbnail","hentry","msr-locale-en_us"],"msr_assoc_parent":{"id":170262,"type":"project"},"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-blog-post\/492176","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-blog-post"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-blog-post"}],"author":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/users\/37242"}],"version-history":[{"count":19,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-blog-post\/492176\/revisions"}],"predecessor-version":[{"id":493799,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-blog-post\/492176\/revisions\/493799"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/499373"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=492176"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=492176"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=492176"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=492176"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}