Ellen M. Voorhees

ORCID

Publication Activity (10 Years)

Years Active: 1984-2024
Publications (10 Years): 35

Top Venues

Publications

Timo Breuer, Ellen M. Voorhees, Ian Soboroff
Browsing and Searching Metadata of TREC. SIGIR (2024)
Murthy V. Devarakonda, Ellen M. Voorhees
Introduction to the Special Issue on Computational Methods for Biomedical NLP. ACM Trans. Comput. Heal. 3 (1) (2022)
Nick Craswell, Bhaskar Mitra, Emine Yilmaz, Daniel Campos, Jimmy Lin, Ellen M. Voorhees, Ian Soboroff
Overview of the TREC 2022 Deep Learning Track. TREC (2022)
Ellen M. Voorhees, Ian Soboroff, Jimmy Lin
Can Old TREC Collections Reliably Evaluate Modern Neural Retrieval Models? CoRR (2022)
Xinyi Yan, Chengxi Luo, Charles L. A. Clarke, Nick Craswell, Ellen M. Voorhees, Pablo Castells
Human Preferences as Dueling Bandits. CoRR (2022)
Kirk Roberts, Dina Demner-Fushman, Ellen M. Voorhees, Steven Bedrick, William R. Hersh
Overview of the TREC 2022 Clinical Trials Track. TREC (2022)
Ellen M. Voorhees, Nick Craswell, Jimmy Lin
Too Many Relevants: Whither Cranfield Test Collections? SIGIR (2022)
Xinyi Yan, Chengxi Luo, Charles L. A. Clarke, Nick Craswell, Ellen M. Voorhees, Pablo Castells
Human Preferences as Dueling Bandits. SIGIR (2022)
Nick Craswell, Bhaskar Mitra, Emine Yilmaz, Daniel Campos, Ellen M. Voorhees, Ian Soboroff
TREC Deep Learning Track: Reusable Test Collections in the Large Data Regime. SIGIR (2021)
Nick Craswell, Bhaskar Mitra, Emine Yilmaz, Daniel Campos, Ellen M. Voorhees, Ian Soboroff
TREC Deep Learning Track: Reusable Test Collections in the Large Data Regime. CoRR (2021)
Kirk Roberts, Tasmeer Alam, Steven Bedrick, Dina Demner-Fushman, Kyle Lo, Ian Soboroff, Ellen M. Voorhees, Lucy Lu Wang, William R. Hersh
Searching for scientific evidence in a pandemic: An overview of TREC-COVID. J. Biomed. Informatics 121 (2021)
Ellen M. Voorhees, Kirk Roberts
On the Quality of the TREC-COVID IR Test Collections. SIGIR (2021)
Kirk Roberts, Tasmeer Alam, Steven Bedrick, Dina Demner-Fushman, Kyle Lo, Ian Soboroff, Ellen M. Voorhees, Lucy Lu Wang, William R. Hersh
Searching for Scientific Evidence in a Pandemic: An Overview of TREC-COVID. CoRR (2021)
Kirk Roberts, Dina Demner-Fushman, Ellen M. Voorhees, Steven Bedrick, William R. Hersh
Overview of the TREC 2020 Precision Medicine Track. TREC (2020)
Ellen M. Voorhees
Coopetition in IR research. SIGIR Forum 54 (2) (2020)
Ellen M. Voorhees, Tasmeer Alam, Steven Bedrick, Dina Demner-Fushman, William R. Hersh, Kyle Lo, Kirk Roberts, Ian Soboroff, Lucy Lu Wang
TREC-COVID: constructing a pandemic information retrieval test collection. SIGIR Forum 54 (1) (2020)
Ellen M. Voorhees
Coopetition in IR Research. SIGIR (2020)
Kirk Roberts, Tasmeer Alam, Steven Bedrick, Dina Demner-Fushman, Kyle Lo, Ian Soboroff, Ellen M. Voorhees, Lucy Lu Wang, William R. Hersh
TREC-COVID: rationale and structure of an information retrieval shared task for COVID-19. J. Am. Medical Informatics Assoc. 27 (9) (2020)
Ellen M. Voorhees, Tasmeer Alam, Steven Bedrick, Dina Demner-Fushman, William R. Hersh, Kyle Lo, Kirk Roberts, Ian Soboroff, Lucy Lu Wang
TREC-COVID: Constructing a Pandemic Information Retrieval Test Collection. CoRR (2020)
Nick Craswell, Bhaskar Mitra, Emine Yilmaz, Daniel Campos, Ellen M. Voorhees
Overview of the TREC 2019 deep learning track. CoRR (2020)
Kirk Roberts, Dina Demner-Fushman, Ellen M. Voorhees, William R. Hersh, Steven Bedrick, Alexander J. Lazar, Shubham Pant, Funda Meric-Bernstam
Overview of the TREC 2019 Precision Medicine Track. TREC (2019)
Kirk Roberts, Dina Demner-Fushman, Ellen M. Voorhees, William R. Hersh, Steven Bedrick, Alexander J. Lazar
Overview of the TREC 2018 Precision Medicine Track. TREC (2018)
Ellen M. Voorhees
On Building Fair and Reusable Test Collections using Bandit Techniques. CIKM (2018)
Kirk Roberts, Dina Demner-Fushman, Ellen M. Voorhees, William R. Hersh, Steven Bedrick, Alexander J. Lazar, Shubham Pant
Benchmarking Information Retrieval for Precision Oncology: the TREC Precision Medicine Track. AMIA (2018)
Chris Buckley, Ellen M. Voorhees
Evaluating Evaluation Measure Stability. SIGIR Forum 51 (2) (2017)
Ellen M. Voorhees, Daniel Samarov, Ian Soboroff
Using Replicates in Information Retrieval Evaluation. ACM Trans. Inf. Syst. 36 (2) (2017)
Jimmy Lin, Salman Mohammed, Royal Sequiera, Luchen Tan, Nimesh Ghelani, Mustafa Abualsaud, Richard McCreadie, Dmitrijs Milajevs, Ellen M. Voorhees
Overview of the TREC 2017 Real-Time Summarization Track. TREC (2017)
Kirk Roberts, Dina Demner-Fushman, Ellen M. Voorhees, William R. Hersh, Steven Bedrick, Alexander J. Lazar, Shubham Pant
Overview of the TREC 2017 Precision Medicine Track. TREC (2017)
James Allan, Donna Harman, Evangelos Kanoulas, Dan Li, Christophe Van Gysel, Ellen M. Voorhees
TREC 2017 Common Core Track Overview. TREC (2017)
Laura Dietz, Elinor Brondwine, Shiri Dori-Hacohen, Ellen M. Voorhees
Women in IR. SIGIR Forum 50 (2) (2016)
Kirk Roberts, Dina Demner-Fushman, Ellen M. Voorhees, William R. Hersh
Overview of the TREC 2016 Clinical Decision Support Track. TREC (2016)
Jimmy Lin, Adam Roegiest, Luchen Tan, Richard McCreadie, Ellen M. Voorhees, Fernando Diaz
Overview of the TREC 2016 Real-Time Summarization Track. TREC (2016)
Kirk Roberts, Matthew S. Simpson, Dina Demner-Fushman, Ellen M. Voorhees, William R. Hersh
State-of-the-art in biomedical literature retrieval for clinical cases: a survey of the TREC 2014 CDS track. Inf. Retr. J. 19 (1-2) (2016)
Ellen M. Voorhees, Shahzad Rajput, Ian Soboroff
Promoting Repeatability Through Open Runs. EVIA@NTCIR (2016)
Seyyed Hadi Hashemi, Jaap Kamps, Julia Kiseleva, Charles L. A. Clarke, Ellen M. Voorhees
Overview of the TREC 2016 Contextual Suggestion Track. TREC (2016)
Jimmy Lin, Miles Efron, Garrick Sherman, Yulu Wang, Ellen M. Voorhees
Overview of the TREC-2015 Microblog Track. TREC (2015)
Ellen M. Voorhees
On the Behavior of PRES Using Incomplete Judgment Sets. ICTIR (2015)
Adriel Dean-Hall, Charles L. A. Clarke, Jaap Kamps, Julia Kiseleva, Ellen M. Voorhees
Overview of the TREC 2015 Contextual Suggestion Track. TREC (2015)
Kirk Roberts, Matthew S. Simpson, Ellen M. Voorhees, William R. Hersh
Overview of the TREC 2015 Clinical Decision Support Track. TREC (2015)
Matthew S. Simpson, Ellen M. Voorhees, William R. Hersh
Overview of the TREC 2014 Clinical Decision Support Track. TREC (2014)
Ellen M. Voorhees, Jimmy Lin, Miles Efron
On run diversity in Evaluation as a Service. SIGIR (2014)
Ellen M. Voorhees, Paul Over, Ian Soboroff
Building Better Search Engines by Measuring Search Quality. IT Prof. 16 (2) (2014)
Kevyn Collins-Thompson, Craig Macdonald, Paul N. Bennett, Fernando Diaz, Ellen M. Voorhees
TREC 2014 Web Track Overview. TREC (2014)
Ellen M. Voorhees
The effect of sampling strategy on inferred measures. SIGIR (2014)
John R. Frank, Max Kleiman-Weiner, Daniel A. Roberts, Ellen M. Voorhees, Ian Soboroff
Evaluating Stream Filtering for Entity Profile Updates in TREC 2012, 2013, and 2014. TREC (2014)
Adriel Dean-Hall, Charles L. A. Clarke, Jaap Kamps, Paul Thomas, Ellen M. Voorhees
Overview of the TREC 2014 Contextual Suggestion Track. TREC (2014)
Ellen M. Voorhees
The TREC Medical Records Track. BCB (2013)
Kevyn Collins-Thompson, Paul N. Bennett, Fernando Diaz, Charlie Clarke, Ellen M. Voorhees
TREC 2013 Web Track Overview. TREC (2013)
John R. Frank, Steven J. Bauer, Max Kleiman-Weiner, Daniel A. Roberts, Nilesh Tripuraneni, Ce Zhang, Christopher Ré, Ellen M. Voorhees, Ian Soboroff
Evaluating Stream Filtering for Entity Profile Updates for TREC 2013. TREC (2013)
Adriel Dean-Hall, Charles L. A. Clarke, Nicole Simone, Jaap Kamps, Paul Thomas, Ellen M. Voorhees
Overview of the TREC 2013 Contextual Suggestion Track. TREC (2013)
Adriel Dean-Hall, Charles L. A. Clarke, Jaap Kamps, Paul Thomas, Ellen M. Voorhees
Overview of the TREC 2012 Contextual Suggestion Track. TREC (2012)
Charles L. A. Clarke, Nick Craswell, Ellen M. Voorhees
Overview of the TREC 2012 Web Track. TREC (2012)
Ellen M. Voorhees, William R. Hersh
Overview of the TREC 2012 Medical Records Track. TREC (2012)
Charles L. A. Clarke, Nick Craswell, Ian Soboroff, Ellen M. Voorhees
Overview of the TREC 2011 Web Track. TREC (2011)
Ellen M. Voorhees
Reflections on TREC QA. CLEF (Notebook Papers/LABs/Workshops) (2010)
Jaap Kamps, Shlomo Geva, Carol Peters, Tetsuya Sakai, Andrew Trotman, Ellen M. Voorhees
Report on the SIGIR 2009 workshop on the future of IR evaluation. SIGIR Forum 43 (2) (2009)
William R. Hersh, Ellen M. Voorhees
TREC genomics special issue overview. Inf. Retr. 12 (1) (2009)
Ellen M. Voorhees
Topic set size redux. SIGIR (2009)
Paul Ogilvie, Ellen M. Voorhees, Jamie Callan
On the number of terms used in automatic query expansion. Inf. Retr. 12 (6) (2009)
Ellen M. Voorhees
Contradictions and Justifications: Extensions to the Textual Entailment Task. ACL (2008)
Ellen M. Voorhees
On test collections for adaptive information retrieval. Inf. Process. Manag. 44 (6) (2008)
Chris Buckley, Darrin Dimmick, Ian Soboroff, Ellen M. Voorhees
Bias and the limits of pooling for large collections. Inf. Retr. 10 (6) (2007)
Ellen M. Voorhees
Overview of TREC 2007. TREC (2007)
Ellen M. Voorhees
TREC: Continuing information retrieval's tradition of experimentation. Commun. ACM 50 (11) (2007)
Ellen M. Voorhees
Overview of the TREC 2006. TREC (2006)
Ellen M. Voorhees
The TREC 2005 robust track. SIGIR Forum 40 (1) (2006)
Shlomo Argamon, Gady Agam, Ophir Frieder, David A. Grossman, David D. Lewis, G. Sohn, Ellen M. Voorhees
A complex document information processing prototype. SIGIR (2006)
Donna Harman, Ellen M. Voorhees
TREC: An overview. Annu. Rev. Inf. Sci. Technol. 40 (1) (2006)
Chris Buckley, Darrin Dimmick, Ian Soboroff, Ellen M. Voorhees
Bias and the limits of pooling. SIGIR (2006)
Ellen M. Voorhees
The TREC robust retrieval track. SIGIR Forum 39 (1) (2005)
Ellen M. Voorhees
Overview of the TREC 2005 Robust Retrieval Track. TREC (2005)
Ellen M. Voorhees
Overview of TREC 2005. TREC (2005)
Ellen M. Voorhees
Using Question Series to Evaluate Question Answering System Effectiveness. HLT/EMNLP (2005)
Ellen M. Voorhees, Hoa Trang Dang
Overview of the TREC 2005 Question Answering Track. TREC (2005)
Ellen M. Voorhees
Measuring ineffectiveness. SIGIR (2004)
Chris Buckley, Ellen M. Voorhees
Retrieval evaluation with incomplete information. SIGIR (2004)
Ellen M. Voorhees
Overview of the TREC 2004 Robust Track. TREC (2004)
Ellen M. Voorhees
Overview of the TREC 2004 Question Answering Track. TREC (2004)
Ellen M. Voorhees
Overview of TREC 2004. TREC (2004)
James Allan, Jay Aslam, Nicholas J. Belkin, Chris Buckley, James P. Callan, W. Bruce Croft, Susan T. Dumais, Norbert Fuhr, Donna Harman, David J. Harper, Djoerd Hiemstra, Thomas Hofmann, Eduard H. Hovy, Wessel Kraaij, John D. Lafferty, Victor Lavrenko, David D. Lewis, Liz Liddy, R. Manmatha, Andrew McCallum, Jay M. Ponte, John M. Prager, Dragomir R. Radev, Philip Resnik, Stephen E. Robertson, Ronald Rosenfeld, Salim Roukos, Mark Sanderson, Richard M. Schwartz, Amit Singhal, Alan F. Smeaton, Howard R. Turtle, Ellen M. Voorhees, Ralph M. Weischedel, Jinxi Xu, ChengXiang Zhai
Challenges in information retrieval and language modeling: report of a workshop held at the center for intelligent information retrieval, University of Massachusetts Amherst, September 2002. SIGIR Forum 37 (1) (2003)
Ellen M. Voorhees
Evaluating Answers to Definition Questions. HLT-NAACL (2003)
Ellen M. Voorhees
Evaluating the Evaluation: A Case Study Using the TREC 2002 Question Answering Track. HLT-NAACL (2003)
Ellen M. Voorhees
Overview of TREC 2003. TREC (2003)
Ian Soboroff, Ellen M. Voorhees, Nick Craswell
Summary of the SIGIR 2003 workshop on defining evaluation methodologies for terabyte-scale test collections. SIGIR Forum 37 (2) (2003)
Ellen M. Voorhees
Overview of the TREC 2003 Question Answering Track. TREC (2003)
Ellen M. Voorhees
Overview of the TREC 2003 Robust Retrieval Track. TREC (2003)
Ellen M. Voorhees
Overview of TREC 2002. TREC (2002)
Ellen M. Voorhees
Overview of the TREC 2002 Question Answering Track. TREC (2002)
Ellen M. Voorhees, Chris Buckley
The effect of topic set size on retrieval experiment error. SIGIR (2002)
Ellen M. Voorhees
Report on TREC-9. SIGIR Forum 34 (2) (2001)
Ellen M. Voorhees
Question Answering in TREC. CIKM (2001)
Donna Harman, Ellen M. Voorhees
Report from TREC-9. CLEF (Working Notes) (2001)
Ellen M. Voorhees
The TREC question answering track. Nat. Lang. Eng. 7 (4) (2001)
Ellen M. Voorhees
Evaluation by Highly Relevant Documents. SIGIR (2001)
Ellen M. Voorhees
The Philosophy of Information Retrieval Evaluation. CLEF (2001)
Ellen M. Voorhees
Overview of TREC 2001. TREC (2001)
Ellen M. Voorhees
Overview of the TREC 2001 Question Answering Track. TREC (2001)
Ellen M. Voorhees
Philosophy of IR Evaluation. CLEF (Working Notes) (2001)
Ellen M. Voorhees
Overview of the TREC-9 Question Answering Track. TREC (2000)
Ellen M. Voorhees, Donna Harman
Overview of the Sixth Text REtrieval Conference (TREC-6). Inf. Process. Manag. 36 (1) (2000)

Ellen M. Voorhees.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

Ellen M. Voorhees