抄録
RD-004
NTCIREVAL: A Generic Toolkit for Information Access Evaluation
○Tetsuya Sakai（Microsoft）
This paper discusses the philosophy behind and the functionalities of a generic evaluation tool for information access (IA) research, called NTCIREVAL. Because IA research relies much on experimentation, sharing such an evaluation toolkit among the IA researchers should help enhance reproducibility of experiments, and also foster discussions on how to better evaluate IA tasks. This paper should also serve as a brief survey of recent developments in the field of IA evaluation metrics.