Mark D. Smucker

Publication Activity (10 Years)

Years Active: 1995-2023
Publications (10 Years): 39

Top Topics

Relevance Judgements

Evaluation Measures

Correct Answers

Top Venues

Publications

Mahsa Seifikar, Linh Nhi Phan Minh, Negar Arabzadeh, Charles L. A. Clarke, Mark D. Smucker
A Preference Judgment Tool for Authoritative Assessment. SIGIR (2023)
Dake Zhang, Amir Vakili Tahami, Mustafa Abualsaud, Mark D. Smucker
Learning Trustworthy Web Sources to Derive Correct Answers and Reduce Health Misinformation in Search. SIGIR (2022)
Mustafa Abualsaud, Mark D. Smucker
The Dark Side of Relevance: The Effect of Non-Relevant Results on Search Behavior. CHIIR (2022)
Amir Vakili Tahami, Dake Zhang, Mark D. Smucker
UWaterlooMDS at the TREC 2022 Health Misinformation Track. TREC (2022)
Charles L. A. Clarke, Maria Maistro, Mark D. Smucker
Overview of the TREC 2021 Health Misinformation Track. TREC (2021)
Charles L. A. Clarke, Alexandra Vtyurina, Mark D. Smucker
Assessing Top- Preferences. ACM Trans. Inf. Syst. 39 (3) (2021)
Charles L. A. Clarke, Chengxi Luo, Mark D. Smucker
Evaluation Measures Based on Preference Graphs. SIGIR (2021)
Mustafa Abualsaud, Mark D. Smucker, Charles L. A. Clarke
Visualizing Searcher Gaze Patterns. CHIIR (2021)
Mustafa Abualsaud, Kamyar Ghajar, Linh Nhi Phan Minh, Dake Zhang, Irene Xiangyi Chen, Mark D. Smucker, Amir Vakili Tahami
UWaterlooMDS at the TREC 2021 Health Misinformation Track. TREC (2021)
Haotian Zhang, Gordon V. Cormack, Maura R. Grossman, Mark D. Smucker
Evaluating sentence-level relevance feedback for high-recall information retrieval. Inf. Retr. J. 23 (1) (2020)
Charles L. A. Clarke, Alexandra Vtyurina, Mark D. Smucker
Offline Evaluation without Gain. ICTIR (2020)
Charles L. A. Clarke, Mark D. Smucker, Alexandra Vtyurina
Offline Evaluation by Maximum Similarity to an Ideal Ranking. CIKM (2020)
Charles L. A. Clarke, Alexandra Vtyurina, Mark D. Smucker
Assessing top-k preferences. CoRR (2020)
Charles L. A. Clarke, Saira Rizvi, Mark D. Smucker, Maria Maistro, Guido Zuccon
Overview of the TREC 2020 Health Misinformation Track. TREC (2020)
Amira Ghenai, Mark D. Smucker, Charles L. A. Clarke
A Think-Aloud Study to Understand Factors Affecting Online Health Search. CHIIR (2020)
Mustafa Abualsaud, Fuat C. Beylunioglu, Mark D. Smucker, P. Robert Duimering
UWaterlooMDS at the TREC 2019 Decision Track. TREC (2019)
Gordon V. Cormack, Haotian Zhang, Nimesh Ghelani, Mustafa Abualsaud, Mark D. Smucker, Maura R. Grossman, Shahin Rahbariasl, Amira Ghenai
Dynamic Sampling Meets Pooling. SIGIR (2019)
Mustafa Abualsaud, Mark D. Smucker
Patterns of Search Result Examination: Query to First Action. CIKM (2019)
Shahin Rahbariasl, Mark D. Smucker
Time-Limits and Summaries for Faster Relevance Assessing. SIGIR (2019)
Haotian Zhang, Gordon V. Cormack, Maura R. Grossman, Mark D. Smucker
Evaluating Sentence-Level Relevance Feedback for High-Recall Information Retrieval. CoRR (2018)
Haotian Zhang, Mustafa Abualsaud, Mark D. Smucker
A Study of Immediate Requery Behavior in Search. CHIIR (2018)
Haotian Zhang, Mustafa Abualsaud, Nimesh Ghelani, Mark D. Smucker, Gordon V. Cormack, Maura R. Grossman
Effective User Interaction for High-Recall Retrieval: Less is More. CIKM (2018)
Mustafa Abualsaud, Gordon V. Cormack, Nimesh Ghelani, Amira Ghenai, Maura R. Grossman, Shahin Rahbariasl, Haotian Zhang, Mark D. Smucker
UWaterlooMDS at the TREC 2018 Common Core Track. TREC (2018)
Nimesh Ghelani, Gordon V. Cormack, Mark D. Smucker
Refresh Strategies in Continuous Active Learning. ProfS/KG4IR/Data:Search@SIGIR (2018)
Mustafa Abualsaud, Nimesh Ghelani, Haotian Zhang, Mark D. Smucker, Gordon V. Cormack, Maura R. Grossman
A System for Efficient High-Recall Retrieval. SIGIR (2018)
J. Shane Culpepper, Fernando Diaz, Mark D. Smucker
Research Frontiers in Information Retrieval: Report from the Third Strategic Workshop on Information Retrieval in Lorne (SWIRL 2018). SIGIR Forum 52 (1) (2018)
Frances A. Pogacar, Amira Ghenai, Mark D. Smucker, Charles L. A. Clarke
The Positive and Negative Influence of Search Results on People's Decisions about the Efficacy of Medical Treatments. ICTIR (2017)
James Allan, Nicholas J. Belkin, Paul N. Bennett, Jamie Callan, Charles L. A. Clarke, Fernando Diaz, Susan T. Dumais, Nicola Ferro, Donna Harman, Djoerd Hiemstra, Ian Ruthven, Tetsuya Sakai, Mark D. Smucker, Justin Zobel
Overview of Special Issue. SIGIR Forum 51 (2) (2017)
Haotian Zhang, Mustafa Abualsaud, Nimesh Ghelani, Angshuman Ghosh, Mark D. Smucker, Gordon V. Cormack, Maura R. Grossman
UWaterlooMDS at the TREC 2017 Common Core Track. TREC (2017)
Haotian Zhang, Jinfeng Rao, Jimmy Lin, Mark D. Smucker
Automatically Extracting High-Quality Negative Examples for Answer Selection in Question Answering. SIGIR (2017)
Mark D. Smucker, Charles L. A. Clarke
Modeling Optimal Switching Behavior. CHIIR (2016)
Aiman Lafi Al-Harbi, Mark D. Smucker
Are Secondary Assessors Uncertain When They Disagree About Relevance Judgements? CHIIR (2016)
Haotian Zhang, Jimmy Lin, Gordon V. Cormack, Mark D. Smucker
Sampling Strategies and Active Learning for Volume Estimation. SIGIR (2016)
Gaurav Baruah, Haotian Zhang, Rakesh Guttikonda, Jimmy Lin, Mark D. Smucker, Olga Vechtomova
Optimizing Nugget Annotations with Active Learning. CIKM (2016)
Luchen Tan, Haotian Zhang, Charles L. A. Clarke, Mark D. Smucker
Lexical Comparison Between Wikipedia and Twitter Corpora by Using Word Embeddings. ACL (2) (2015)
Haotian Zhang, Wu Lin, Yipeng Wang, Charles L. A. Clarke, Mark D. Smucker
WaterlooClarke: TREC 2015 Total Recall Track. TREC (2015)
Charles L. A. Clarke, Mark D. Smucker, Emine Yilmaz
IR Evaluation: Modeling User Behavior for Measuring Effectiveness. SIGIR (2015)
Gaurav Baruah, Mark D. Smucker, Charles L. A. Clarke
Evaluating Streams of Evolving News Events. SIGIR (2015)
Gaurav Baruah, Adam Roegiest, Mark D. Smucker
Pooling for User-Oriented Evaluation Measures. ICTIR (2015)
Gaurav Baruah, Adam Roegiest, Mark D. Smucker
The effect of expanding relevance judgements with duplicates. SIGIR (2014)
Aiman Lafi Al-Harbi, Mark D. Smucker
A qualitative exploration of secondary assessor relevance judging behavior. IIiX (2014)
Charles L. A. Clarke, Mark D. Smucker
Time well spent. IIiX (2014)
Mark D. Smucker, Xiaoyu Sunny Guo, Andrew Toulis
Mouse movement during relevance judging: implications for determining user attention. SIGIR (2014)
Le Li, Mark D. Smucker
Tolerance of Effectiveness Measures to Relevance Judging Errors. ECIR (2014)
Krisztian Balog, David Elsweiler, Evangelos Kanoulas, Liadh Kelly, Mark D. Smucker
Report on the CIKM workshop on living labs for information retrieval evaluation. SIGIR Forum 48 (1) (2014)
Mark D. Smucker, Gabriella Kazai, Matthew Lease
Overview of the TREC 2013 Crowdsourcing Track. TREC (2013)
Charles L. A. Clarke, Luanne Freund, Mark D. Smucker, Emine Yilmaz
Report on the SIGIR 2013 workshop on modeling user behavior for information retrieval evaluation (MUBE 2013). SIGIR Forum 47 (2) (2013)
Krisztian Balog, David Elsweiler, Evangelos Kanoulas, Liadh Kelly, Mark D. Smucker
CIKM 2013 workshop on living labs for information retrieval evaluation. CIKM (2013)
Robert Capra, Luanne Freund, Catherine L. Smith, Mark D. Smucker, Ryen W. White
HCIR 2013: the seventh international symposium on human-computer interaction and information retrieval. SIGIR Forum 47 (2) (2013)
Charles L. A. Clarke, Luanne Freund, Mark D. Smucker, Emine Yilmaz
SIGIR 2013 workshop on modeling user behavior for information retrieval evaluation. SIGIR (2013)
Mark D. Smucker, Charles L. A. Clarke
Time-based calibration of effectiveness measures. SIGIR (2012)
Mark D. Smucker, Charles L. A. Clarke
The Fault, Dear Researchers, is not in Cranfield, But in our Metrics, that they are Unrealistic. EuroHCIR (2012)
Mark D. Smucker, Gabriella Kazai, Matthew Lease
Overview of the TREC 2012 Crowdsourcing Track. TREC (2012)
Mark D. Smucker, James Allan, Blagovest Dachev
Human question answering performance using an interactive document retrieval system. IIiX (2012)
Mark D. Smucker, Chandra Prakash Jethani
Time to judge relevance as an indicator of assessor error. SIGIR (2012)
Mark D. Smucker, Charles L. A. Clarke
Stochastic simulation of time-biased gain. CIKM (2012)
Mark D. Smucker, Charles L. A. Clarke
Modeling user variance in time-biased gain. HCIR (2012)
Mark D. Smucker
Crowdsourcing with a Crowd of One and Other TREC 2011 Crowdsourcing and Web Track Experiments. TREC (2011)
Mark D. Smucker, Chandra Prakash Jethani
Measuring assessor accuracy: a comparison of nist assessors and user study participants. SIGIR (2011)
Gordon V. Cormack, Mark D. Smucker, Charles L. A. Clarke
Efficient and effective spam filtering and re-ranking for large web datasets. Inf. Retr. 14 (5) (2011)
Leif Azzopardi, Kalervo Järvelin, Jaap Kamps, Mark D. Smucker
Report on the SIGIR 2010 workshop on the simulation of interaction. SIGIR Forum 44 (2) (2010)
Gordon V. Cormack, Mark D. Smucker, Charles L. A. Clarke
Efficient and Effective Spam Filtering and Re-ranking for Large Web Datasets CoRR (2010)
Mark D. Smucker, Chandra Prakash Jethani
Human performance and retrieval precision revisited. SIGIR (2010)
Mark D. Smucker, Charles L. A. Clarke, Gordon V. Cormack, Olga Vechtomova
University of Waterloo at TREC 2010: Legal Interactive. TREC (2010)
Mark D. Smucker, James Allan, Ben Carterette
Agreement among statistical significance tests for information retrieval evaluation at varying sample sizes. SIGIR (2009)
Mark D. Smucker, James Allan
A New Measure of the Cluster Hypothesis. ICTIR (2009)
Mark D. Smucker, Charles L. A. Clarke, Gordon V. Cormack
Experiments with ClueWeb09: Relevance Feedback and Web Tracks. TREC (2009)
Jimmy Lin, Mark D. Smucker
How do users find things with PubMed?: towards automatic utility evaluation with user simulations. SIGIR (2008)
Rebecca Reznik-Zellen, Bob Stevens, Michael Thorn, Jeff Morse, Mark D. Smucker, James Allan, David M. Mimno, Andrew McCallum, Mark Tuominen
InterNano: e-Science for the Nanomanufacturing Community. eScience (2008)
Ben Carterette, Mark D. Smucker
Hypothesis testing with incomplete relevance judgments. CIKM (2007)
Mark D. Smucker, James Allan, Ben Carterette
A comparison of statistical significance tests for information retrieval evaluation. CIKM (2007)
Mark D. Smucker, James Allan
Using similarity links as shortcuts to relevant web pages. SIGIR (2007)
Mark D. Smucker, James Allan, Blagovest Dachev
UMass Complex Interactive Question Answering (ciQA) 2007: Human Performance as Question Answerers. TREC (2007)
Mark D. Smucker, James Allan
Find-similar: similarity browsing as a search tool. SIGIR (2006)
Mark D. Smucker
UMass Genomics 2006: Query-Biased Pseudo Relevance Feedback. TREC (2006)
Mark D. Smucker, James Allan
Lightening the load of document smoothing for better language modeling retrieval. SIGIR (2006)
Nasreen Abdul Jaleel, James Allan, W. Bruce Croft, Fernando Diaz, Leah S. Larkey, Xiaoyan Li, Mark D. Smucker, Courtney Wade
UMass at TREC 2004: Novelty and HARD. TREC (2004)
Dan Ashlock, Mark D. Smucker, John Walker
Graph based genetic algorithms. CEC (1999)
E. Ann Stanley, Dan Ashlock, Mark D. Smucker
Iterated Prisoner's Dilemma with Choice and Refusal of Partners: Evolutionary Results. ECAL (1995)