INST: An Adaptive Metric for Information Retrieval Evaluation

  • Alistair Moffat ,
  • Peter Bailey ,
  • Falk Scholer ,
  • Paul Thomas

Proceedings of the 20th Australasian Document Computing Symposium (ADCS'15) |

Published by ACM - Association for Computing Machinery

Publication

A large number of metrics have been proposed to measure the effectiveness of information retrieval systems. Here we provide a detailed explanation of one recent proposal, INST, articulate the various properties that it embodies, and describe a number of pragmatic issues that need to be taken in to account when writing an implementation. The result is a specification for a program inst_eval for use in TREC-style IR experimentation.