Paul Thomas

Publication Activity (10 Years)

Years Active: 2005-2024
Publications (10 Years): 38

Top Topics

Information Retrieval

Search Behavior

Human Relevance Judgments

Top Venues

Publications

Paul Thomas, Gabriella Kazai, Nick Craswell, Seth Spielman
What Matters in a Measure? A Perspective from Large-Scale Search Evaluation. SIGIR (2024)
Alexander Frummet, Andrea Papenmeier, Maik Fröbe, Johannes Kiesel, Vaibhav Adlakha, Norbert Braunschweiler, Mateusz Dubiel, Satanu Ghosh, Marcel Gohsen, Christin Kreutz, Milad Momeni, Markus Nilles, Sachin Pathiyan Cherumanal, Abbas Pirmoradi, Paul Thomas, Johanne R. Trippas, Ines Zelch, Oleg Zendel
Report on the 8th Workshop on Search-Oriented Conversational Artificial Intelligence (SCAI 2024) at CHIIR 2024. SIGIR Forum 58 (1) (2024)
Hossein A. Rahmani, Clemencia Siro, Mohammad Aliannejadi, Nick Craswell, Charles L. A. Clarke, Guglielmo Faggioli, Bhaskar Mitra, Paul Thomas, Emine Yilmaz
LLM4Eval: Large Language Model for Evaluation in IR. SIGIR (2024)
Paul Thomas, Seth Spielman, Nick Craswell, Bhaskar Mitra
Large Language Models can Accurately Predict Searcher Preferences. SIGIR (2024)
Oleg Zendel, J. Shane Culpepper, Falk Scholer, Paul Thomas
Enhancing Human Annotation: Leveraging Large Language Models and Efficient Batch Processing. CHIIR (2024)
Marwah Alaofi, Luke Gallagher, Mark Sanderson, Falk Scholer, Paul Thomas
Can Generative LLMs Create Query Variants for Test Collections? An Exploratory Study. SIGIR (2023)
Paul Thomas, Seth Spielman, Nick Craswell, Bhaskar Mitra
Large language models can accurately predict searcher preferences. CoRR (2023)
Chirag Shah, Ryen White, Paul Thomas, Bhaskar Mitra, Shawon Sarkar, Nicholas J. Belkin
Taking Search to Task. CHIIR (2023)
Chirag Shah, Ryen W. White, Paul Thomas, Bhaskar Mitra, Shawon Sarkar, Nicholas J. Belkin
Taking Search to Task. CoRR (2023)
Paul Thomas, Gabriella Kazai, Ryen White, Nick Craswell
The Crowd is Made of People: Observations from Large-Scale Crowd Labelling. CHIIR (2022)
Alistair Moffat, Joel Mackenzie, Paul Thomas, Leif Azzopardi
A Flexible Framework for Offline Effectiveness Metrics. SIGIR (2022)
Damiano Spina, Johanne R. Trippas, Paul Thomas, Hideo Joho, Katriina Byström, Leigh Clark, Nick Craswell, Mary Czerwinski, David Elsweiler, Alexander Frummet, Souvick Ghosh, Johannes Kiesel, Irene Lopatovska, Daniel McDuff, Selina Meyer, Ahmed Mourad, Paul Owoicho, Sachin Pathiyan Cherumanal, Daniel Russell, Laurianne Sitbon
Report on the future conversations workshop at CHIIR 2021. SIGIR Forum 55 (1) (2021)
Daniel McDuff, Paul Thomas, Nick Craswell, Kael Rowan, Mary Czerwinski
Do Affective Cues Validate Behavioural Metrics for Search? SIGIR (2021)
Leif Azzopardi, Alistair Moffat, Paul Thomas, Guido Zuccon
User Models, Metrics and Measures of Search: A Tutorial on the C/W/L Evaluation Framework. CHIIR (2021)
Krisztian Balog, David Maxwell, Paul Thomas, Shuo Zhang
Report on the 1st simulation for information retrieval workshop (Sim4IR 2021) at SIGIR 2021. SIGIR Forum 55 (2) (2021)
Mohammad Aliannejadi, Leif Azzopardi, Hamed Zamani, Evangelos Kanoulas, Paul Thomas, Nick Craswell
Analysing Mixed Initiatives and Search Strategies during Conversational Search. CIKM (2021)
Paul Thomas, Mary Czerwinksi, Daniel McDuff, Nick Craswell
Theories of Conversation for Conversational IR. ACM Trans. Inf. Syst. 39 (4) (2021)
Mohammad Aliannejadi, Leif Azzopardi, Hamed Zamani, Evangelos Kanoulas, Paul Thomas, Nick Craswell
Analysing Mixed Initiatives and Search Strategies during Conversational Search. CoRR (2021)
Krisztian Balog, David Maxwell, Paul Thomas, Shuo Zhang
Sim4IR: The SIGIR 2021 Workshop on Simulation for Information Retrieval Evaluation. SIGIR (2021)
Johanne R. Trippas, Paul Thomas, Damiano Spina, Hideo Joho
Third International Workshop on Conversational Approaches to Information Retrieval (CAIR'20): Full-day Workshop at CHIIR 2020. CHIIR (2020)
Paul Thomas, Daniel J. McDuff, Mary Czerwinski, Nick Craswell
Expressions of Style in Information Seeking Conversation with an Agent. SIGIR (2020)
Leif Azzopardi, Ryen W. White, Paul Thomas, Nick Craswell
Data-Driven Evaluation Metrics for Heterogeneous Search Engine Result Pages. CHIIR (2020)
Paul Thomas, Bodo Billerbeck, Nick Craswell, Ryen W. White
Investigating Searchers' Mental Models to Inform Search Explanations. ACM Trans. Inf. Syst. 38 (1) (2020)
Johanne R. Trippas, Damiano Spina, Paul Thomas, Mark Sanderson, Hideo Joho, Lawrence Cavedon
Towards a model for spoken conversational search. Inf. Process. Manag. 57 (2) (2020)
Gabriella Kazai, Paul Thomas, Nick Craswell
The Emotion Profile of Web Search. SIGIR (2019)
Johanne R. Trippas, Damiano Spina, Paul Thomas, Mark Sanderson, Hideo Joho, Lawrence Cavedon
Towards a Model for Spoken Conversational Search. CoRR (2019)
Leif Azzopardi, Paul Thomas, Alistair Moffat
cwl_eval: An Evaluation Tool for Information Retrieval. SIGIR (2019)
Leif Azzopardi, Alistair Moffat, Paul Thomas, Guido Zuccon
Building Economic Models and Measures of Search. SIGIR (2019)
Johanne R. Trippas, Paul Thomas
Data Sets for Spoken Conversational Search. BIIRRR@CHIIR (2019)
Paul Thomas, Mary Czerwinski, Daniel J. McDuff, Nick Craswell, Gloria Mark
Style and Alignment in Information-Seeking Conversation. CHIIR (2018)
Leif Azzopardi, Paul Thomas, Nick Craswell
Measuring the Utility of Search Engine Result Pages: An Information Foraging Based Measure. SIGIR (2018)
Paul Thomas, Alistair Moffat, Peter Bailey, Falk Scholer, Nick Craswell
Better Effectiveness Metrics for SERPs, Cards, and Rankings. ADCS (2018)
Alistair Moffat, Peter Bailey, Falk Scholer, Paul Thomas
Incorporating User Expectations and Behavior into the Measurement of Search Effectiveness. ACM Trans. Inf. Syst. 35 (3) (2017)
Paul Thomas, Falk Scholer, Peter Bailey, Alistair Moffat
Tasks, Queries, and Rankers in Pre-Retrieval Performance Prediction. ADCS (2017)
Peter Bailey, Alistair Moffat, Falk Scholer, Paul Thomas
Retrieval Consistency in the Presence of Query Variations. SIGIR (2017)
Daniel J. McDuff, Paul Thomas, Mary Czerwinski, Nick Craswell
Multimodal analysis of vocal collaborative search: a public corpus and results. ICMI (2017)
Peter Bailey, Alistair Moffat, Falk Scholer, Paul Thomas
UQV100: A Test Collection with Query Variability. SIGIR (2016)
Heather L. O'Brien, Nicola Ferro, Hideo Joho, Dirk Lewandowski, Paul Thomas, Keith van Rijsbergen
System And User Centered Evaluation Approaches in Interactive Information Retrieval (SAUCE 2016). CHIIR (2016)
Paul Thomas, Peter Bailey, Alistair Moffat, Falk Scholer
Towards Nuanced System Evaluation Based on Implicit User Expectations. AIRS (2015)
Alistair Moffat, Falk Scholer, Paul Thomas, Peter Bailey
Pooled Evaluation Over Query Variations: Users are as Diverse as Systems. CIKM (2015)
Peter Bailey, Alistair Moffat, Falk Scholer, Paul Thomas
User Variability and IR System Evaluation. SIGIR (2015)
Timothy Jones, Paul Thomas, Falk Scholer, Mark Sanderson
Features of Disagreement Between Retrieval Effectiveness Measures. SIGIR (2015)
Liyuan Zhou, David Hawking, Paul Thomas
Text segmentation and Chinese site search. ADCS (2015)
Alistair Moffat, Peter Bailey, Falk Scholer, Paul Thomas
INST: An Adaptive Metric for Information Retrieval Evaluation. ADCS (2015)
Alistair Moffat, Peter Bailey, Falk Scholer, Paul Thomas
Assessing the Cognitive Complexity of Information Needs. ADCS (2014)
Paul Thomas, Alistair Moffat, Peter Bailey, Falk Scholer
Modeling decision points in user search behavior. IIiX (2014)
Paul Thomas, Falk Scholer, Alistair Moffat
Fading Away: Dilution and User Behaviour. EuroHCIR (2013)
Alistair Moffat, Paul Thomas, Falk Scholer
Users versus models: what observation tells us about effectiveness metrics. CIKM (2013)
Paul Thomas, Falk Scholer, Alistair Moffat
What Users Do: The Eyes Have It. AIRS (2013)
Falk Scholer, Alistair Moffat, Paul Thomas
Choices in batch information retrieval evaluation. ADCS (2013)
PengFei (Vincent) Li, Paul Thomas, David Hawking
Merging algorithms for enterprise search. ADCS (2013)
Alistair Moffat, Falk Scholer, Paul Thomas
Models and metrics: IR evaluation as a user process. ADCS (2012)
Paul Thomas, Timothy Jones, David Hawking
What deliberately degrading search quality tells us about discount functions. SIGIR (2011)
Timothy Jones, David Hawking, Paul Thomas, Ramesh S. Sankaranarayana
Relative effect of spam and irrelevant documents on user interaction with search engines. CIKM (2011)
Milad Shokouhi, Leif Azzopardi, Paul Thomas
Effective query expansion for federated search. SIGIR (2009)
Paul Thomas, David Hawking
Server selection methods in personal metasearch: a comparative empirical study. Inf. Retr. 12 (5) (2009)
Krisztian Balog, Arjen P. de Vries, Pavel Serdyukov, Paul Thomas, Thijs Westerveld
Overview of the TREC 2009 Entity Track. TREC (2009)
Paul Thomas, David Hawking
Experiences evaluating personal metasearch. IIiX (2008)
Peter Bailey, Nick Craswell, Ian Soboroff, Paul Thomas, Arjen P. de Vries, Emine Yilmaz
Relevance assessment: are judges exchangeable and does it matter. SIGIR (2008)
Krisztian Balog, Ian Soboroff, Paul Thomas, Peter Bailey, Nick Craswell, Arjen P. de Vries
Overview of the TREC 2008 Enterprise Track. TREC (2008)
Paul Thomas, David Hawking
Evaluating sampling methods for uncooperative collections. SIGIR (2007)
Paul Thomas, David Hawking
Evaluation by comparing result sets in context. CIKM (2006)
Mingfang Wu, David Hawking, Paul Thomas
TREC 14 Enterprise Track at CSIRO and ANU. TREC (2005)
David Hawking, Paul Thomas
Server selection methods in hybrid portal search. SIGIR (2005)