Will Pyramids Built of Nuggets Topple Over?

  title={Will Pyramids Built of Nuggets Topple Over?},
  author={Jimmy J. Lin and Dina Demner-Fushman},
The present methodology for evaluating complex questions at TREC analyzes answers in terms of facts called “nuggets”. The official F-score metric represents the harmonic mean between recall and precision at the nugget level. There is an implicit assumption that some facts are more important than others, which is implemented in a binary split between “vital” and “okay” nuggets. This distinction holds important implications for the TREC scoring model—essentially, systems only receive credit for… CONTINUE READING
Highly Cited
This paper has 84 citations. REVIEW CITATIONS

8 Figures & Tables



Citations per Year

84 Citations

Semantic Scholar estimates that this publication has 84 citations based on the available data.

See our FAQ for additional information.