{"id":546906,"date":"2018-10-31T12:29:48","date_gmt":"2018-10-31T19:29:48","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-blog-post&p=546906"},"modified":"2019-03-14T11:10:12","modified_gmt":"2019-03-14T18:10:12","slug":"emnlp-conference-analytics","status":"publish","type":"msr-blog-post","link":"https:\/\/www.microsoft.com\/en-us\/research\/articles\/emnlp-conference-analytics\/","title":{"rendered":"EMNLP Conference Analytics"},"content":{"rendered":"

The Microsoft Academic Graph<\/a> makes it possible to gain analytic insights about any of the entities within it: publications, authors (opens in new tab)<\/span><\/a>, institutions (opens in new tab)<\/span><\/a>, topics (opens in new tab)<\/span><\/a>,\u00a0 journals (opens in new tab)<\/span><\/a>\u00a0and conferences (opens in new tab)<\/span><\/a>. In this series, we present analytic insights about current conferences, which we hope will help you prepare for attending each event. All the insights within are derived from the Microsoft Academic Graph and visualized in Microsoft Power BI. You can generate your own insights by accessing the Microsoft Academic Graph through the\u00a0Academic Knowledge API (opens in new tab)<\/span><\/a>\u00a0or through\u00a0Azure Storage (opens in new tab)<\/span><\/a>\u00a0(please\u00a0contact us<\/a>\u00a0for the latter option). If you would like to learn how we generated the insights below, please see the\u00a0repository with source code (opens in new tab)<\/span><\/a>.<\/p>\n

In this post, we present historical trend analysis about the conference EMNLP–Conference on Empirical Methods in Natural Language Processing (opens in new tab)<\/span><\/a>, taking place in Brussels, Belgium from October 31-November 4, 2018<\/strong>. We derive insights from 1996 to the latest available year.<\/p>\n

Click on each image for current trends and data hosted by\u00a0Microsoft Academic Graph<\/a>.<\/em><\/p>\n

EMNLP paper output<\/h1>\n

The chart below shows the evolution of number of conference papers for each conference year.<\/p>\n

\"Conference (opens in new tab)<\/span><\/a><\/p>\n

In the following chart, the black bars represent the average numbers of papers each conference paper references for each conference year. The data show that recent publications tend to reference more papers. The green bars show the average numbers of citations received by a conference paper for each conference year. Note that the citations are raw counts and are not normalized by the age of publications. This is because normalizing citation counts turns out to be a nontrivial problem and may well be application dependent. Please treat the raw data presented as an invitation to conduct research on this topic!<\/p>\n

\"2 (opens in new tab)<\/span><\/a><\/p>\n

*Average Citations: Average number of citations an EMNLP paper received<\/strong> for a given conference year<\/p>\n

*Average References: Average number of references an EMNLP paper references for a given conference year<\/p>\n

The notable citation spike in 2002 is mostly due to Pang, Bo, et al. \u201cThumbs up? Sentiment Classification Using Machine Learning Techniques.\u201d\u00a0Proceedings of the 2002 Conference on Empirical Methods in Natural Language Processing<\/em>, 2002, pp. 79\u201386, (opens in new tab)<\/span><\/a>with 7,817 citations.<\/p>\n

The chart below shows the citation distribution among EMNLP papers.<\/p>\n

\"3<\/p>\n

Diving in deeper, 12.5 percent of the conference papers received at least 50 citations. As these conference papers contributed 79.04 percent of the total citations received by the conference, the Pareto principle (opens in new tab)<\/span><\/a> roughly applies.<\/p>\n

\"4<\/p>\n

Memory of references<\/h1>\n

How old are papers cited by EMNLP papers? Follow a given year\u2019s column to see the age of papers cited in conference papers published that year. For example, in 2016, EMNLP papers collectively cited 1,131 papers published in 2015, 782 papers published in 2014, and so on.<\/p>\n

\"5 (opens in new tab)<\/span><\/a><\/p>\n

*If some years appear to cite publications from the future, it is likely due to two scenarios. First, they cited papers that are published in journals later. Second, they cited books. When a new edition of the book appeared, it replaced the previous one in the Microsoft Academic Graph, and the citation appears to be from the future. In this representation, we remove all instances of papers citing papers more than one year in the future to generate a cleaner view.<\/em><\/p>\n

Outgoing references<\/h1>\n

What venues do\u00a0EMNLP papers cite?<\/p>\n

The bar chart shows the top 10 venues cited by\u00a0EMNLP papers. ACL, EMNLP, NAACL and Computational Linguistics emerge as the top 4.<\/p>\n

\"6 (opens in new tab)<\/span><\/a><\/p>\n

The 100 percent stacked bar chart below shows the percent of references given by EMNLP\u00a0papers to each of the top 10 venues, year by year.<\/p>\n

\"7 (opens in new tab)<\/span><\/a><\/p>\n

Incoming citations<\/h1>\n

What venues cite EMNLP papers?<\/p>\n

The bar chart below shows the top 10 venues that cite EMNLP papers.\u00a0 Again, ACL is at the top, followed by EMNLP and NAACL. See the table for year-by-year details of citations coming from each of the top 10 venues.<\/p>\n

\"8 (opens in new tab)<\/span><\/a><\/p>\n

The 100 percent stacked bar chart below shows the citation distribution from the top 10 citing venues, year by year.<\/p>\n

\"9 (opens in new tab)<\/span><\/a><\/p>\n

Most-cited authors<\/h1>\n

Who are the most-cited authors of all time by EMNLP papers? The chart below ranks the most-cited authors by using number of publications cited by the conference and number of citations received from the conference. Authors do not have to have published in EMNLP to appear on this chart.<\/p>\n

\"10 (opens in new tab)<\/span><\/a><\/p>\n

Who are the rising stars among the top-cited authors in EMNLP? The 100 percent stacked bar chart below shows the citation distribution by the top 20 authors, year by year.<\/p>\n

\"11 (opens in new tab)<\/span><\/a><\/p>\n

Top institutions<\/h1>\n

The bubble chart visualizes the top institutions at EMNLP by citation count. The size of the bubble is proportional to the total number of publications from that institution at EMNLP.<\/p>\n

\"12 (opens in new tab)<\/span><\/a><\/p>\n

Get the most current data and also explore the top institutions at the conference in more detail by clicking the chart. Once on the underlying Microsoft Power BI report, click on a column to rank the top institutions by publication or citation count.<\/p>\n

\"13 (opens in new tab)<\/span><\/a><\/p>\n

Top authors<\/h1>\n

The next three charts show author rankings according to different criteria.<\/p>\n

The bubble chart displays EMNLP authors ranked by citation count, with bubble size being relative to publication count.<\/p>\n

\"14 (opens in new tab)<\/span><\/a><\/p>\n

Get the most current data and also explore the top authors at the conference in more detail by clicking the chart. Once on the underlying Microsoft Power BI report, you can also explore the top conference authors in more detail. Click on a column to rank the top authors by Microsoft Academic rank, publication, or citation count.<\/p>\n

\"15 (opens in new tab)<\/span><\/a><\/p>\n

The bubble chart below visualizes author rank, which is calculated by Microsoft Academic by using a formula that is less susceptible to citation counts than similar measures. The X axis shows author rank. The higher an author\u2019s rank, the closer they are to the right side. The Y axis normalizes the rank by publication count and enables us to identify impactful authors who might not have had a very large number of publications. The closer an author is to the top, the higher their normalized rank. Of course, the area of the chart that represents the highest rank is the top right corner.<\/p>\n

\"16 (opens in new tab)<\/span><\/a><\/p>\n

We hope you have enjoyed the analytic insights into this conference made possible by the page to learn how you can use our knowledge graph to generate your own custom analytics about an institution, a topic, an author, a publication venue, or any combination of these.<\/p>\n

As always, we would like to hear from you either through the feedback link at the bottom right of the\u00a0website (opens in new tab)<\/span><\/a>, or on\u00a0Twitter (opens in new tab)<\/span><\/a>. You can also find our project home page with this blog on the Microsoft Research site at\u00a0aka.ms\/msracad (opens in new tab)<\/span><\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"

The Microsoft Academic Graph makes it possible to gain analytic insights about any of the entities within it: publications, authors, institutions, topics,\u00a0 journals\u00a0and conferences. In this series, we present analytic insights about current conferences, which we hope will help you prepare for attending each event. All the insights within are derived from the Microsoft Academic […]<\/p>\n","protected":false},"author":37239,"featured_media":546660,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","msr-content-parent":170262,"msr_hide_image_in_river":0,"footnotes":""},"research-area":[],"msr-locale":[268875],"msr-post-option":[],"class_list":["post-546906","msr-blog-post","type-msr-blog-post","status-publish","has-post-thumbnail","hentry","msr-locale-en_us"],"msr_assoc_parent":{"id":170262,"type":"project"},"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-blog-post\/546906","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-blog-post"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-blog-post"}],"author":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/users\/37239"}],"version-history":[{"count":6,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-blog-post\/546906\/revisions"}],"predecessor-version":[{"id":573417,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-blog-post\/546906\/revisions\/573417"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media\/546660"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=546906"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=546906"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=546906"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=546906"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}