DataPerf: Benchmarks for Data-Centric AI Development.

Mark Mazumder Colby R. Banbury Xiaozhe Yao Bojan Karlas William Gaviria Rojas Sudnya Frederick Diamos Greg Diamos Lynn He Alicia Parrish Hannah Rose Kirk Jessica Quaye Charvi Rastogi Douwe Kiela David Jurado David Kanter Rafael Mosquera Will Cukierski Juan Ciro Lora Aroyo Bilge Acun Lingjiao Chen Mehul Raje Max Bartolo Evan Sabri Eyuboglu Amirata Ghorbani Emmett D. Goodman Addison Howard Oana Inel Tariq Kane Christine R. Kirkpatrick D. Sculley Tzu-Sheng Kuo Jonas W. Mueller Tristan Thrush Joaquin Vanschoren Margaret Warren Adina Williams Serena Yeung Newsha Ardalani Praveen K. Paritosh Ce Zhang James Y. Zou Carole-Jean Wu Cody Coleman Andrew Y. Ng Peter Mattson Vijay Janapa Reddi

Published in: NeurIPS (2023)

Keyphrases

data centric
artificial intelligence
expert systems
case study
data management
business processes
information management
database
software engineering
data driven
development process
challenges facing
data representation
design process
data points
domain knowledge
data sets