The Fault, Dear Researchers, is not in Cranfield, But in our Metrics, that they are Unrealistic.

Mark D. Smucker Charles L. A. Clarke

Published in: EuroHCIR (2012)

Keyphrases

evaluation measures
fault diagnosis
fault detection
data mining
computer science
search tasks
researchers and practitioners
evaluation metrics
graduate students
simplifying assumptions
digital libraries
test data
training data
real world
similarity metrics
failure modes
real time embedded systems