Matthew Lease

ORCID

Publication Activity (10 Years)

Years Active: 2002-2024
Publications (10 Years): 98

Top Venues

Publications

Venelin Kovatchev, Matthew Lease
Benchmark Transparency: Measuring the Impact of Data on Evaluation. CoRR (2024)
Gauri Kambhatla, Matthew Lease, Ashwin Rajadesingan
Promoting Constructive Deliberation: Reframing for Receptiveness. CoRR (2024)
Terrence Neumann, Sooyong Lee, Maria De-Arteaga, Sina Fazelpour, Matthew Lease
Diverse, but Divisive: LLMs Can Exaggerate Gender Differences in Opinion Related to Harms of Misinformation. CoRR (2024)
Alex C. Williams, Min Bai, Jonathan Buck, Tristan J. McKinney, Amy Rechkemmer, Koushik Kalyanaraman, Matthew Lease, Patrick Haffner, Xiong Zhou, Li Erran Li
Snapper: Accelerating Bounding Box Annotation in Object Detection Tasks with Find-and-Snap Tooling. IUI (2024)
Soumyajit Gupta, Venelin Kovatchev, Maria De-Arteaga, Matthew Lease
Fairly Accurate: Optimizing Accuracy Parity in Fair Target-Group Detection. CoRR (2024)
Venelin Kovatchev, Matthew Lease
Benchmark Transparency: Measuring the Impact of Data on Evaluation. NAACL-HLT (2024)
Alexander Braylan, Madalyn Marabella, Omar Alonso, Matthew Lease
A General Model for Aggregating Annotations AcrossSimple, Complex, and Multi-object Annotation Tasks (Abstract Reprint). AAAI (2024)
Mehmet Deniz Türkmen, Matthew Lease, Mücahid Kutlu
New Metrics to Encourage Innovation and Diversity in Information Retrieval Approaches. ECIR (2) (2023)
Vijay Keswani, L. Elisa Celis, Krishnaram Kenthapadi, Matthew Lease
Designing Closed-Loop Models for Task Allocation. CoRR (2023)
Alexander Braylan, Madalyn Marabella, Omar Alonso, Matthew Lease
A General Model for Aggregating Annotations Across Simple, Complex, and Multi-Object Annotation Tasks. CoRR (2023)
Soumyajit Gupta, Sooyong Lee, Maria De-Arteaga, Matthew Lease
Same Same, But Different: Conditional Multi-Task Learning for Demographic-Specific Toxicity Detection. WWW (2023)
Jie Yang, Alessandro Bozzon, Ujwal Gadiraju, Matthew Lease
Editorial: Human-centered AI: Crowd computing. Frontiers Artif. Intell. 6 (2023)
Mehmet Deniz Türkmen, Matthew Lease, Mücahid Kutlu
New Metrics to Encourage Innovation and Diversity in Information Retrieval Approaches. CoRR (2023)
Anubrata Das, Houjiang Liu, Venelin Kovatchev, Matthew Lease
The State of Human-centered NLP Technology for Fact-checking. CoRR (2023)
Vijay Keswani, L. Elisa Celis, Krishnaram Kenthapadi, Matthew Lease
Designing Closed-Loop Models for Task Allocation. HHAI (2023)
Alexander Braylan, Madalyn Marabella, Omar Alonso, Matthew Lease
A General Model for Aggregating Annotations Across Simple, Complex, and Multi-Object Annotation Tasks. J. Artif. Intell. Res. 78 (2023)
Yiheng Su, Junyi Jessy Li, Matthew Lease
Interpretable by Design: Wrapper Boxes Combine Neural Performance with Faithful Explanations. CoRR (2023)
Soumyajit Gupta, Sooyong Lee, Maria De-Arteaga, Matthew Lease
Same Same, But Different: Conditional Multi-Task Learning for Demographic-Specific Toxicity Detection. CoRR (2023)
Danula Hettiachchi, Indigo Holcombe-James, Stephanie Livingstone, Anjalee de Silva, Matthew Lease, Flora D. Salim, Mark Sanderson
How Crowd Worker Factors Influence Subjective Annotations: A Study of Tagging Misogynistic Hate Speech in Tweets. CoRR (2023)
Houjiang Liu, Anubrata Das, Alexander Boltz, Didi Zhou, Daisy Pinaroc, Matthew Lease, Min Kyung Lee
Human-centered NLP Fact-checking: Co-Designing with Fact-checkers using Matchmaking for AI. CoRR (2023)
Ruijiang Gao, Maytal Saar-Tsechansky, Maria De-Arteaga, Ligong Han, Wei Sun, Min Kyung Lee, Matthew Lease
Learning Complementary Policies for Human-AI Teams. CoRR (2023)
Luis Oala, Manil Maskey, Lilith Bat-Leah, Alicia Parrish, Nezihe Merve Gürel, Tzu-Sheng Kuo, Yang Liu, Rotem Dror, Danilo Brajovic, Xiaozhe Yao, Max Bartolo, William Gaviria Rojas, Ryan Hileman, Rainier Aliment, Michael W. Mahoney, Meg Risdal, Matthew Lease, Wojciech Samek, Debojyoti Dutta, Curtis G. Northcutt, Cody Coleman, Braden Hancock, Bernard Koch, Girmaw Abebe Tadesse, Bojan Karlas, Ahmed Alaa, Adji Bousso Dieng, Natasha F. Noy, Vijay Janapa Reddi, James Zou, Praveen K. Paritosh, Mihaela van der Schaar, Kurt D. Bollacker, Lora Aroyo, Ce Zhang, Joaquin Vanschoren, Isabelle Guyon, Peter Mattson
DMLR: Data-centric Machine Learning Research - Past, Present and Future. CoRR (2023)
Anubrata Das, Houjiang Liu, Venelin Kovatchev, Matthew Lease
The state of human-centered NLP technology for fact-checking. Inf. Process. Manag. 60 (2) (2023)
Prateek Chaudhry, Matthew Lease
You Are What You Tweet: Profiling Users by Past Tweets to Improve Hate Speech Detection. iConference (2) (2022)
Alexander Braylan, Omar Alonso, Matthew Lease
Measuring Annotator Agreement Generally across Complex Structured, Multi-object, and Free-text Annotation Tasks. WWW (2022)
Soumyajit Gupta, Gurpreet Singh, Raghu Bollapragada, Matthew Lease
Learning a neural Pareto manifold extractor with constraints. UAI (2022)
Venelin Kovatchev, Soumyajit Gupta, Matthew Lease
Fairly Accurate: Learning Optimal Accuracy vs. Fairness Tradeoffs for Hate Speech Detection. CoRR (2022)
Li Shi, Nilavra Bhattacharya, Anubrata Das, Matthew Lease, Jacek Gwizdka
The Effects of Interactive AI Design on User Behavior: An Eye-tracking Study of Fact-checking COVID-19 Claims. CoRR (2022)
Md. Mustafizur Rahman, Mücahid Kutlu, Matthew Lease
Understanding and Predicting Characteristics of Test Collections in Information Retrieval. iConference (2) (2022)
Vijay Keswani, Matthew Lease, Krishnaram Kenthapadi
Designing Closed Human-in-the-loop Deferral Pipelines. CoRR (2022)
Anubrata Das, Chitrank Gupta, Venelin Kovatchev, Matthew Lease, Junyi Jessy Li
ProtoTEx: Explaining Model Decisions with Prototype Tensors. CoRR (2022)
Alexander Braylan, Omar Alonso, Matthew Lease
Measuring Annotator Agreement Generally across Complex Structured, Multi-object, and Free-text Annotation Tasks. CoRR (2022)
Vivek Krishna Pradhan, Mike Schaekermann, Matthew Lease
In Search of Ambiguity: A Three-Stage Workflow Design to Clarify Annotation Guidelines for Crowd Workers. Frontiers Artif. Intell. 5 (2022)
Caifan Du, Matthew Lease
Voices of Workers: Why a Worker-Centered Approach to Crowd Work Is Challenging. CoRR (2022)
Lora Aroyo, Matthew Lease, Praveen K. Paritosh, Mike Schaekermann
Data excellence for AI: why should you care? Interactions 29 (2) (2022)
Venelin Kovatchev, Trina Chatterjee, Venkata Subrahmanyan Govindarajan, Jifan Chen, Eunsol Choi, Gabriella Chronis, Anubrata Das, Katrin Erk, Matthew Lease, Junyi Jessy Li, Yating Wu, Kyle Mahowald
longhorns at DADC 2022: How many linguists does it take to fool a Question Answering model? A systematic approach to adversarial attacks. CoRR (2022)
Anubrata Das, Chitrank Gupta, Venelin Kovatchev, Matthew Lease, Junyi Jessy Li
ProtoTEx: Explaining Model Decisions with Prototype Tensors. ACL (1) (2022)
Ruijiang Gao, Maytal Saar-Tsechansky, Maria De-Arteaga, Ligong Han, Min Kyung Lee, Matthew Lease
Human-AI Collaboration with Bandit Feedback. IJCAI (2021)
Vijay Keswani, Matthew Lease, Krishnaram Kenthapadi
Towards Unbiased and Accurate Deferral to Multiple Experts. CoRR (2021)
Gurpreet Singh, Soumyajit Gupta, Matthew Lease, Clint Dawson
A Hybrid 2-stage Neural Optimization for Pareto Front Extraction. CoRR (2021)
Danula Hettiachchi, Mark Sanderson, Jorge Gonçalves, Simo Hosio, Gabriella Kazai, Matthew Lease, Mike Schaekermann, Emine Yilmaz
Proceedings of the CSCW 2021 Workshop - Investigating and Mitigating Biases in Crowdsourced Data. CoRR (2021)
Soumyajit Gupta, Gurpreet Singh, Anubrata Das, Matthew Lease
Pareto Solutions vs Dataset Optima: Concepts and Methods for Optimizing Competing Objectives with Constraints in Retrieval. ICTIR (2021)
Miriah Steiger, Timir J. Bharucha, Sukrit Venkatagiri, Martin J. Riedl, Matthew Lease
The Psychological Well-Being of Content Moderators: The Emotional Labor of Commercial Moderation and Avenues for Improving Support. CHI (2021)
Ruijiang Gao, Maytal Saar-Tsechansky, Maria De-Arteaga, Ligong Han, Min Kyung Lee, Matthew Lease
Human-AI Collaboration with Bandit Feedback. CoRR (2021)
Danula Hettiachchi, Mike Schaekermann, Tristan McKinney, Matthew Lease
The Challenge of Variable Effort Crowdsourcing and How Visible Gold Can Help. Proc. ACM Hum. Comput. Interact. 5 (CSCW2) (2021)
Gurpreet Singh, Soumyajit Gupta, Matthew Lease, Clint Dawson
SCA-Net: A Self-Correcting Two-Layer Autoencoder for Hyper-spectral Unmixing. CoRR (2021)
Vijay Keswani, Matthew Lease, Krishnaram Kenthapadi
Towards Unbiased and Accurate Deferral to Multiple Experts. AIES (2021)
Alexander Braylan, Matthew Lease
Aggregating Complex Annotations via Merging and Matching. KDD (2021)
Prakhar Singh, Anubrata Das, Junyi Jessy Li, Matthew Lease
The Case for Claim Difficulty Assessment in Automatic Fact Checking. CoRR (2021)
Soumyajit Gupta, Gurpreet Singh, Matthew Lease
Scalable Uni-directional Pareto Optimality for Multi-Task Learning with Constraints. CoRR (2021)
Danula Hettiachchi, Mark Sanderson, Jorge Gonçalves, Simo Hosio, Gabriella Kazai, Matthew Lease, Mike Schaekermann, Emine Yilmaz
Investigating and Mitigating Biases in Crowdsourced Data. CSCW Companion (2021)
Lora Aroyo, Matthew Lease, Praveen K. Paritosh, Mike Schaekermann
Data Excellence for AI: Why Should You Care. CoRR (2021)
Danula Hettiachchi, Mike Schaekermann, Tristan McKinney, Matthew Lease
The Challenge of Variable Effort Crowdsourcing and How Visible Gold Can Help. CoRR (2021)
Md. Mustafizur Rahman, Dinesh Balakrishnan, Dhiraj Murthy, Mücahid Kutlu, Matthew Lease
An Information Retrieval Approach to Building Datasets for Hate Speech Detection. CoRR (2021)
Vivek Krishna Pradhan, Mike Schaekermann, Matthew Lease
In Search of Ambiguity: A Three-Stage Workflow Design to Clarify Annotation Guidelines for Crowd Workers. CoRR (2021)
Alexander Braylan, Matthew Lease
Modeling and Aggregation of Complex Annotations via Annotation Distances. WWW (2020)
Md. Mustafizur Rahman, Mücahid Kutlu, Matthew Lease
Understanding and Predicting the Characteristics of Test Collections. CoRR (2020)
Gurpreet Singh, Soumyajit Gupta, Matthew Lease
Extracting Optimal Solution Manifolds using Constrained Neural Optimization. CoRR (2020)
Prateek Chaudhry, Matthew Lease
You Are What You Tweet: Profiling Users by Past Tweets to Improve Hate Speech Detection. CoRR (2020)
Mücahid Kutlu, Tyler McDonnell, Tamer Elsayed, Matthew Lease
Annotator Rationales for Labeling Tasks in Crowdsourcing. J. Artif. Intell. Res. 69 (2020)
Gurpreet Singh, Soumyajit Gupta, Matthew Lease, Clint Dawson
Streaming Singular Value Decomposition for Big Data Applications. CoRR (2020)
Md. Mustafizur Rahman, Mücahid Kutlu, Tamer Elsayed, Matthew Lease
Efficient Test Collection Construction via Active Learning. ICTIR (2020)
Anubrata Das, Brandon Dang, Matthew Lease
Fast, Accurate, and Healthier: Interactive Blurring Helps Moderators Reduce Exposure to Harmful Content. HCOMP (2020)
An T. Nguyen, Matthew Lease, Byron C. Wallace
Explainable modeling of annotations in crowdsourcing. IUI (2019)
Anubrata Das, Matthew Lease
A Conceptual Framework for Evaluating Fairness in Search. CoRR (2019)
Alexandra Olteanu, Jean Garcia-Gathright, Maarten de Rijke, Michael D. Ekstrand, Adam Roegiest, Aldo Lipani, Alex Beutel, Ana Lucic, Ana-Andreea Stoica, Anubrata Das, Asia Biega, Bart Voorn, Claudia Hauff, Damiano Spina, David D. Lewis, Douglas W. Oard, Emine Yilmaz, Faegheh Hasibi, Gabriella Kazai, Graham McDonald, Hinda Haned, Iadh Ounis, Ilse van der Linden, Joris Baan, Kamuela N. Lau, Krisztian Balog, Mahmoud F. Sayed, Maria Panteli, Mark Sanderson, Matthew Lease, Preethi Lahoti, Toshihiro Kamishima
FACTS-IR: fairness, accountability, confidentiality, transparency, and safety in information retrieval. SIGIR Forum 53 (2) (2019)
Anubrata Das, Kunjan Mehta, Matthew Lease
CobWeb: A Research Prototype for Exploring User Bias in Political Fact-Checking. CoRR (2019)
Md. Mustafizur Rahman, Mücahid Kutlu, Matthew Lease
Constructing Test Collections using Multi-armed Bandits and Active Learning. WWW (2019)
Soumyajit Gupta, Mücahid Kutlu, Vivek Khetan, Matthew Lease
Correlation, Prediction and Ranking of Evaluation Metrics in Information Retrieval. ECIR (1) (2019)
Brandon Dang, Martin J. Riedl, Matthew Lease
Toward Safer Crowdsourced Content Moderation. CoRR (2018)
An T. Nguyen, Aditya Kharosekar, Saumyaa Krishnan, Siddhesh Krishnan, Elizabeth Tate, Byron C. Wallace, Matthew Lease
Believe it or not: Designing a Human-AI Partnership for Mixed-Initiative Fact-Checking. UIST (2018)
Mücahid Kutlu, Vivek Khetan, Matthew Lease
Correlation and Prediction of Evaluation Metrics in Information Retrieval. CoRR (2018)
Mücahid Kutlu, Tamer Elsayed, Maram Hasanain, Matthew Lease
When Rank Order Isn't Enough: New Statistical-Significance-Aware Correlation Measures. CIKM (2018)
Mücahid Kutlu, Tamer Elsayed, Matthew Lease
Intelligent topic selection for low-cost information retrieval evaluation: A New perspective on deep vs. shallow judging. Inf. Process. Manag. 54 (1) (2018)
An T. Nguyen, Aditya Kharosekar, Matthew Lease, Byron C. Wallace
An Interpretable Joint Graphical Model for Fact-Checking From Crowds. AAAI (2018)
Mücahid Kutlu, Tyler McDonnell, Aashish Sheshadri, Tamer Elsayed, Matthew Lease
Mix and Match: Collaborative Expert-Crowd Judging for Building Test Collections Accurately and Affordably. CoRR (2018)
Tanya Goyal, Tyler McDonnell, Mücahid Kutlu, Tamer Elsayed, Matthew Lease
Your Behavior Signals Your Reliability: Modeling Crowd Behavioral Traces to Ensure Quality Relevance Annotations. HCOMP (2018)
Matthew Lease
Fact Checking and Information Retrieval. DESIRES (2018)
Mücahid Kutlu, Tyler McDonnell, Yassmine Barkallah, Tamer Elsayed, Matthew Lease
Crowd vs. Expert: What Can Relevance Judgment Rationales Teach Us About Assessor Disagreement? SIGIR (2018)
Md. Mustafizur Rahman, Mücahid Kutlu, Tamer Elsayed, Matthew Lease
Efficient Test Collection Construction via Active Learning. CoRR (2018)
Kezban Dilek Onal, Ye Zhang, Ismail Sengor Altingovde, Md. Mustafizur Rahman, Pinar Karagoz, Alex Braylan, Brandon Dang, Heng-Lu Chang, Henna Kim, Quinten McNamara, Aaron Angert, Edward Banner, Vivek Khetan, Tyler McDonnell, An Thanh Nguyen, Dan Xu, Byron C. Wallace, Maarten de Rijke, Matthew Lease
Neural information retrieval: at the end of the early years. Inf. Retr. J. 21 (2-3) (2018)
Lora Aroyo, Anca Dumitrache, Jeffrey V. Nickerson, Matthew Lease, Pietro Michelucci
Reports of the Workshops Held at the Sixth AAAI Conference on Human Computation and Crowdsourcing. AI Mag. 39 (4) (2018)
Mücahid Kutlu, Tyler McDonnell, Aashish Sheshadri, Tamer Elsayed, Matthew Lease
Mix and Match: Collaborative Expert-Crowd Judging for Building Test Collections Accurately and Affordably. DESIRES (2018)
Akash Mankar, Riddhi J. Shah, Matthew Lease
Design Activism for Minimum Wage Crowd Work. CoRR (2017)
Mücahid Kutlu, Tamer Elsayed, Matthew Lease
Learning to Effectively Select Topics For Information Retrieval Test Collections. CoRR (2017)
Ye Zhang, Matthew Lease, Byron C. Wallace
Active Discriminative Text Representation Learning. AAAI (2017)
Ye Zhang, Matthew Lease, Byron C. Wallace
Exploiting Domain Knowledge via Grouped Weight Sharing with Application to Text Categorization. CoRR (2017)
Tyler McDonnell, Mücahid Kutlu, Tamer Elsayed, Matthew Lease
The Many Benefits of Annotator Rationales for Relevance Judgments. IJCAI (2017)
Ye Zhang, Matthew Lease, Byron C. Wallace
Exploiting Domain Knowledge via Grouped Weight Sharing with Application to Text Categorization. ACL (2) (2017)
Xi Zheng, Akanksha Bansal, Matthew Lease
Bullseye: structured passage retrieval and document highlighting for scholarly search. ACSW (2017)
An Thanh Nguyen, Byron C. Wallace, Junyi Jessy Li, Ani Nenkova, Matthew Lease
Aggregating and Predicting Sequence Labels from Crowd Annotations. ACL (1) (2017)
An T. Nguyen, Byron C. Wallace, Matthew Lease
A Correlated Worker Model for Grouped, Imbalanced and Multitask Data. UAI (2016)
Tyler McDonnell, Matthew Lease, Mücahid Kutlu, Tamer Elsayed
Why Is That Relevant? Collecting Annotator Rationales for Relevance Judgments. HCOMP (2016)
Yalin Sun, Pengxiang Cheng, Shengwei Wang, Hao Lyu, Matthew Lease, Iain James Marshall, Byron C. Wallace
Crowdsourcing Information Extraction for Biomedical Systematic Reviews. CoRR (2016)
Ye Zhang, Md. Mustafizur Rahman, Alex Braylan, Brandon Dang, Heng-Lu Chang, Henna Kim, Quinten McNamara, Aaron Angert, Edward Banner, Vivek Khetan, Tyler McDonnell, An Thanh Nguyen, Dan Xu, Byron C. Wallace, Matthew Lease
Neural Information Retrieval: A Literature Review. CoRR (2016)
An Thanh Nguyen, Matthew Halpern, Byron C. Wallace, Matthew Lease
Probabilistic Modeling for Crowdsourcing Partially-Subjective Ratings. HCOMP (2016)
Brandon Dang, Miles Hutson, Matthew Lease
MmmTurkey: A Crowdsourcing Framework for Deploying Tasks and Recording Worker Behavior on Amazon Mechanical Turk. CoRR (2016)
Reem Suwaileh, Mücahid Kutlu, Nihal Fathima, Tamer Elsayed, Matthew Lease
ArabicWeb16: A New Crawl for Today's Arabic Web. SIGIR (2016)
An Thanh Nguyen, Byron C. Wallace, Matthew Lease
Combining Crowd and Expert Labels Using Decision Theoretic Active Learning. HCOMP (2015)
Hyun Joon Jung, Matthew Lease
A Discriminative Approach to Predicting Assessor Accuracy. ECIR (2015)

Matthew Lease.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

Matthew Lease