I work as part of a Microsoft team on Communication Intelligence.
I have several abiding interests in Information Retrieval, including Evaluation and Measurement, Personalization and User Modeling, and Ranking.
I have been involved over the years in TREC as a co-coordinator of the Web track (in the period 1999-2000) where I worked with David Hawking and Nick Craswell in developing and releasing a number of widely-used test collections, including WT10g. More recently, I was a co-coordinator of the Enterprise track (in 2007-2008), where we developed the CERC test collection. I also review papers for several conferences, including SIGIR, WWW, WSDM. I wrote a short series of tips on paper writing for SIGIR (see SIGIR Tips tab), and occasionally try to publish papers and posters with colleagues. From 2014-2019, I have had an extended collaboration with Paul Thomas, Alistair Moffat and Falk Scholer, examining user variability and better ways of information seeking measurement. We developed a new metric (INST) and produced a new test collection, UQV100, to help investigate this issue. More recently I have been working on email, including producing two datasets for addressee tagging and dialogue summarization.
While at Microsoft I have worked on a number of measurement, ranking and recommendation problems at the heart of Bing, including measurement of whole page relevance, and a slew of issues related to personalization of ranking. For about 3 years, I was the dev manager for the Bing Contextual Relevance team, which introduced personalized and contextual Web ranking to Bing’s results for the first time. We collaborated closely with the MSR CLUES team, helping to carry out tech transfer of various user modeling techniques.
My current research interests centre on semantic comprehension of text, with especial application to information interaction technologies like search and email. I continue to spend a lot of time thinking about measurement of such interactions.