Sara Hooker

Publication Activity (10 Years)

Years Active: 2017-2024
Publications (10 Years): 70

Top Topics

Top Venues

EMNLP (Findings)

Publications

Shivalika Singh, Freddie Vargus, Daniel D'souza, Börje Karlsson, Abinaya Mahendiran, Wei-Yin Ko, Herumb Shandilya, Jay Patel, Deividas Mataciunas, Laura O'Mahony, Mike Zhang, Ramith Hettiarachchi, Joseph Wilson, Marina Machado, Luisa Souza Moura, Dominik Krzeminski, Hakimeh Fadaei, Irem Ergün, Ifeoma Okoh, Aisha Alaagib, Oshan Mudannayake, Zaid Alyafeai, Minh Vu Chien, Sebastian Ruder, Surya Guthikonda, Emad A. Alghamdi, Sebastian Gehrmann, Niklas Muennighoff, Max Bartolo, Julia Kreutzer, Ahmet Üstün, Marzieh Fadaee, Sara Hooker
Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning. ACL (1) (2024)
Shayne Longpre, Robert Mahari, Ariel Lee, Campbell Lund, Hamidah Oderinwale, William Brannon, Nayan Saxena, Naana Obeng-Marnu, Tobin South, Cole Hunter, Kevin Klyman, Christopher Klamm, Hailey Schoelkopf, Nikhil Singh, Manuel Cherep, Ahmad Anis, An Dinh, Caroline Chitongo, Da Yin, Damien Sileo, Deividas Mataciunas, Diganta Misra, Emad A. Alghamdi, Enrico Shippole, Jianguo Zhang, Joanna Materzynska, Kun Qian, Kush Tiwary, Lester James V. Miranda, Manan Dey, Minnie Liang, Mohammed Hamdy, Niklas Muennighoff, Seonghyeon Ye, Seungone Kim, Shrestha Mohanty, Vipul Gupta, Vivek Sharma, Vu Minh Chien, Xuhui Zhou, Yizhi Li, Caiming Xiong, Luis Villa, Stella Biderman, Hanlin Li, Daphne Ippolito, Sara Hooker, Jad Kabbara, Sandy Pentland
Consent in Crisis: The Rapid Decline of the AI Data Commons. CoRR (2024)
Ahmet Üstün, Viraat Aryabumi, Zheng Xin Yong, Wei-Yin Ko, Daniel D'souza, Gbemileke Onilude, Neel Bhandari, Shivalika Singh, Hui-Lee Ooi, Amr Kayid, Freddie Vargus, Phil Blunsom, Shayne Longpre, Niklas Muennighoff, Marzieh Fadaee, Julia Kreutzer, Sara Hooker
Aya Model: An Instruction Finetuned Open-Access Multilingual Language Model. CoRR (2024)
Aakanksha, Arash Ahmadian, Beyza Ermis, Seraphina Goldfarb-Tarrant, Julia Kreutzer, Marzieh Fadaee, Sara Hooker
The Multilingual Alignment Prism: Aligning Global and Local Preferences to Reduce Harm. CoRR (2024)
Arash Ahmadian, Chris Cremer, Matthias Gallé, Marzieh Fadaee, Julia Kreutzer, Olivier Pietquin, Ahmet Üstün, Sara Hooker
Back to Basics: Revisiting REINFORCE Style Optimization for Learning from Human Feedback in LLMs. CoRR (2024)
John Dang, Arash Ahmadian, Kelly Marchisio, Julia Kreutzer, Ahmet Üstün, Sara Hooker
RLHF Can Speak Many Languages: Unlocking Multilingual Preference Optimization for LLMs. CoRR (2024)
Viraat Aryabumi, John Dang, Dwarak Talupuru, Saurabh Dash, David Cairuz, Hangyu Lin, Bharat Venkitesh, Madeline Smith, Jon Ander Campos, Yi Chern Tan, Kelly Marchisio, Max Bartolo, Sebastian Ruder, Acyr Locatelli, Julia Kreutzer, Nick Frosst, Aidan N. Gomez, Phil Blunsom, Marzieh Fadaee, Ahmet Üstün, Sara Hooker
Aya 23: Open Weight Releases to Further Multilingual Progress. CoRR (2024)
Luísa Shimabucoro, Sebastian Ruder, Julia Kreutzer, Marzieh Fadaee, Sara Hooker
LLM See, LLM Do: Guiding Data Generation to Target Non-Differentiable Objectives. CoRR (2024)
Kelly Marchisio, Saurabh Dash, Hongyu Chen, Dennis Aumiller, Ahmet Üstün, Sara Hooker, Sebastian Ruder
How Does Quantization Affect Multilingual LLMs? CoRR (2024)
Luiza Pozzobon, Patrick Lewis, Sara Hooker, Beyza Ermis
From One to Many: Expanding the Scope of Toxicity Mitigation in Language Models. CoRR (2024)
Everlyn Chimoto, Jay Gala, Orevaoghene Ahia, Julia Kreutzer, Bruce A. Bassett, Sara Hooker
Critical Learning Periods: Leveraging Early Training Dynamics for Efficient Data Pruning. ACL (Findings) (2024)
Arash Ahmadian, Chris Cremer, Matthias Gallé, Marzieh Fadaee, Julia Kreutzer, Olivier Pietquin, Ahmet Üstün, Sara Hooker
Back to Basics: Revisiting REINFORCE-Style Optimization for Learning from Human Feedback in LLMs. ACL (1) (2024)
Shivalika Singh, Freddie Vargus, Daniel D'souza, Börje F. Karlsson, Abinaya Mahendiran, Wei-Yin Ko, Herumb Shandilya, Jay Patel, Deividas Mataciunas, Laura O'Mahony, Mike Zhang, Ramith Hettiarachchi, Joseph Wilson, Marina Machado, Luisa Souza Moura, Dominik Krzeminski, Hakimeh Fadaei, Irem Ergün, Ifeoma Okoh, Aisha Alaagib, Oshan Mudannayake, Zaid Alyafeai, Minh Chien Vu, Sebastian Ruder, Surya Guthikonda, Emad A. Alghamdi, Sebastian Gehrmann, Niklas Muennighoff, Max Bartolo, Julia Kreutzer, Ahmet Üstün, Marzieh Fadaee, Sara Hooker
Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning. CoRR (2024)
Beyza Ermis, Luiza Pozzobon, Sara Hooker, Patrick Lewis
From One to Many: Expanding the Scope of Toxicity Mitigation in Language Models. ACL (Findings) (2024)
Anka Reuel, Ben Bucknall, Stephen Casper, Tim Fist, Lisa Soder, Onni Aarne, Lewis Hammond, Lujain Ibrahim, Alan Chan, Peter Wills, Markus Anderljung, Ben Garfinkel, Lennart Heim, Andrew Trask, Gabriel Mukobi, Rylan Schaeffer, Mauricio Baker, Sara Hooker, Irene Solaiman, Alexandra Sasha Luccioni, Nitarshan Rajkumar, Nicolas Moës, Jeffrey Ladish, Neel Guha, Jessica Newman, Yoshua Bengio, Tobin South, Alex Pentland, Sanmi Koyejo, Mykel J. Kochenderfer, Robert Trager
Open Problems in Technical AI Governance. CoRR (2024)
Ted Zadouri, Ahmet Üstün, Arash Ahmadian, Beyza Ermis, Acyr Locatelli, Sara Hooker
Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuning. ICLR (2024)
David Ifeoluwa Adelani, Jessica Ojo, Israel Abebe Azime, Jian Yun Zhuang, Jesujoba O. Alabi, Xuanli He, Millicent Ochieng, Sara Hooker, Andiswa Bukula, En-Shiun Annie Lee, Chiamaka Chukwuneke, Happy Buzaaba, Blessing K. Sibanda, Godson Kalipe, Jonathan Mukiibi, Salomon Kabongo, Foutse Yuehgoh, Mmasibidi Setaka, Lolwethu Ndolela, Nkiruka Odu, Rooweither Mabuya, Shamsuddeen Hassan Muhammad, Salomey Osei, Sokhar Samb, Tadesse Kebede Guge, Pontus Stenetorp
IrokoBench: A New Benchmark for African Languages in the Age of Large Language Models. CoRR (2024)
Everlyn Asiko Chimoto, Jay Gala, Orevaoghene Ahia, Julia Kreutzer, Bruce A. Bassett, Sara Hooker
Critical Learning Periods: Leveraging Early Training Dynamics for Efficient Data Pruning. CoRR (2024)
Sara Hooker
On the Limitations of Compute Thresholds as a Governance Strategy. CoRR (2024)
Fraser Mince, Dzung Dinh, Jonas Kgomo, Neil Thompson, Sara Hooker
The Grand Illusion: The Myth of Software Portability and Implications for ML Progress. NeurIPS (2023)
Luiza Pozzobon, Beyza Ermis, Patrick Lewis, Sara Hooker
Goodtriever: Adaptive Toxicity Mitigation with Retrieval-augmented Models. EMNLP (Findings) (2023)
Marcos V. Treviso, Ji-Ung Lee, Tianchu Ji, Betty van Aken, Qingqing Cao, Manuel R. Ciosici, Michael Hassid, Kenneth Heafield, Sara Hooker, Colin Raffel, Pedro Henrique Martins, André F. T. Martins, Jessica Zosa Forde, Peter A. Milder, Edwin Simpson, Noam Slonim, Jesse Dodge, Emma Strubell, Niranjan Balasubramanian, Leon Derczynski, Iryna Gurevych, Roy Schwartz
Efficient Methods for Natural Language Processing: A Survey. Trans. Assoc. Comput. Linguistics 11 (2023)
Shayne Longpre, Robert Mahari, Anthony Chen, Naana Obeng-Marnu, Damien Sileo, William Brannon, Niklas Muennighoff, Nathan Khazam, Jad Kabbara, Kartik Perisetla, Xinyi Wu, Enrico Shippole, Kurt D. Bollacker, Tongshuang Wu, Luis Villa, Sandy Pentland, Deb Roy, Sara Hooker
The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI. CoRR (2023)
Arash Ahmadian, Saurabh Dash, Hongyu Chen, Bharat Venkitesh, Stephen Gou, Phil Blunsom, Ahmet Üstün, Sara Hooker
Intriguing Properties of Quantization at Scale. CoRR (2023)
Luiza Pozzobon, Beyza Ermis, Patrick Lewis, Sara Hooker
On the Challenges of Using Black-Box APIs for Toxicity Evaluation in Research. CoRR (2023)
Saiteja Utpala, Sara Hooker, Pin-Yu Chen
Locally Differentially Private Document Generation Using Zero Shot Prompting. CoRR (2023)
Laura Ruis, Akbir Khan, Stella Biderman, Sara Hooker, Tim Rocktäschel, Edward Grefenstette
The Goldilocks of Pragmatic Understanding: Fine-Tuning Strategy Matters for Implicature Resolution by LLMs. NeurIPS (2023)
Irene Solaiman, Zeerak Talat, William Agnew, Lama Ahmad, Dylan K. Baker, Su Lin Blodgett, Hal Daumé III, Jesse Dodge, Ellie Evans, Sara Hooker, Yacine Jernite, Alexandra Sasha Luccioni, Alberto Lusoli, Margaret Mitchell, Jessica Newman, Marie-Therese Png, Andrew Strait, Apostol Vassilev
Evaluating the Social Impact of Generative AI Systems in Systems and Society. CoRR (2023)
Wei-Yin Ko, Daniel D'souza, Karina Nguyen, Randall Balestriero, Sara Hooker
FAIR-Ensemble: When Fairness Naturally Emerges From Deep Ensembling. CoRR (2023)
Meriem Boubdir, Edward Kim, Beyza Ermis, Sara Hooker, Marzieh Fadaee
Elo Uncovered: Robustness and Best Practices in Language Model Evaluation. CoRR (2023)
Serena Lutong Wang, Harikrishna Narasimhan, Yichen Zhou, Sara Hooker, Michal Lukasik, Aditya Krishna Menon
Robust distillation for worst-class performance: on the interplay between teacher and student objectives. UAI (2023)
Fraser Mince, Dzung Dinh, Jonas Kgomo, Neil Thompson, Sara Hooker
The Grand Illusion: The Myth of Software Portability and Implications for ML Progress. CoRR (2023)
Ted Zadouri, Ahmet Üstün, Arash Ahmadian, Beyza Ermis, Acyr Locatelli, Sara Hooker
Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuning. CoRR (2023)
Shoaib Ahmed Siddiqui, Nitarshan Rajkumar, Tegan Maharaj, David Krueger, Sara Hooker
Metadata Archaeology: Unearthing Data Subsets by Leveraging Training Dynamics. ICLR (2023)
Arash Ahmadian, Saurabh Dash, Hongyu Chen, Bharat Venkitesh, Stephen Zhen Gou, Phil Blunsom, Ahmet Üstün, Sara Hooker
Intriguing Properties of Quantization at Scale. NeurIPS (2023)
Max Marion, Ahmet Üstün, Luiza Pozzobon, Alex Wang, Marzieh Fadaee, Sara Hooker
When Less is More: Investigating Data Pruning for Pretraining LLMs at Scale. CoRR (2023)
Saiteja Utpala, Sara Hooker, Pin-Yu Chen
Locally Differentially Private Document Generation Using Zero Shot Prompting. EMNLP (Findings) (2023)
Kale-ab Tessera, Callum Rhys Tilbury, Sasha Abramowitz, Ruan de Kock, Omayma Mahjoub, Benjamin Rosman, Sara Hooker, Arnu Pretorius
Generalisable Agents for Neural Network Optimisation. CoRR (2023)
Sree Harsha Nelaturu, Nishaanth Kanna Ravichandran, Cuong Tran, Sara Hooker, Ferdinando Fioretto
On The Fairness Impacts of Hardware Selection in Machine Learning. CoRR (2023)
Luiza Pozzobon, Beyza Ermis, Patrick Lewis, Sara Hooker
On the Challenges of Using Black-Box APIs for Toxicity Evaluation in Research. EMNLP (2023)
Luiza Pozzobon, Beyza Ermis, Patrick Lewis, Sara Hooker
Goodtriever: Adaptive Toxicity Mitigation with Retrieval-augmented Models. CoRR (2023)
Markus Anderljung, Joslyn Barnhart, Anton Korinek, Jade Leung, Cullen O'Keefe, Jess Whittlestone, Shahar Avin, Miles Brundage, Justin Bullock, Duncan Cass-Beggs, Ben Chang, Tantum Collins, Tim Fist, Gillian K. Hadfield, Alan Hayes, Lewis Ho, Sara Hooker, Eric Horvitz, Noam Kolt, Jonas Schuett, Yonadav Shavit, Divya Siddarth, Robert Trager, Kevin Wolf
Frontier AI Regulation: Managing Emerging Risks to Public Safety. CoRR (2023)
Meriem Boubdir, Edward Kim, Beyza Ermis, Marzieh Fadaee, Sara Hooker
Which Prompts Make The Difference? Data Prioritization For Efficient Human LLM Evaluation. CoRR (2023)
Donglin Zhuang, Xingyao Zhang, Shuaiwen Song, Sara Hooker
Randomness in Neural Network Training: Characterizing the Impact of Tooling. MLSys (2022)
Robin Tibor Schirrmeister, Rosanne Liu, Sara Hooker, Tonio Ball
When less is more: Simplifying inputs aids neural network understanding. CoRR (2022)
Laura Ruis, Akbir Khan, Stella Biderman, Sara Hooker, Tim Rocktäschel, Edward Grefenstette
Large language models are not zero-shot communicators. CoRR (2022)
Kelechi Ogueji, Orevaoghene Ahia, Gbemileke Onilude, Sebastian Gehrmann, Sara Hooker, Julia Kreutzer
Intriguing Properties of Compression on Multilingual Models. CoRR (2022)
Shoaib Ahmed Siddiqui, Nitarshan Rajkumar, Tegan Maharaj, David Krueger, Sara Hooker
Metadata Archaeology: Unearthing Data Subsets by Leveraging Training Dynamics. CoRR (2022)
Marcos V. Treviso, Tianchu Ji, Ji-Ung Lee, Betty van Aken, Qingqing Cao, Manuel R. Ciosici, Michael Hassid, Kenneth Heafield, Sara Hooker, Pedro Henrique Martins, André F. T. Martins, Peter A. Milder, Colin Raffel, Edwin Simpson, Noam Slonim, Niranjan Balasubramanian, Leon Derczynski, Roy Schwartz
Efficient Methods for Natural Language Processing: A Survey. CoRR (2022)
Serena Wang, Harikrishna Narasimhan, Yichen Zhou, Sara Hooker, Michal Lukasik, Aditya Krishna Menon
Robust Distillation for Worst-class Performance. CoRR (2022)
Kelechi Ogueji, Orevaoghene Ahia, Gbemileke Onilude, Sebastian Gehrmann, Sara Hooker, Julia Kreutzer
Intriguing Properties of Compression on Multilingual Models. EMNLP (2022)
Chirag Agarwal, Daniel D'souza, Sara Hooker
Estimating Example Difficulty using Variance of Gradients. CVPR (2022)
Francesco Corti, Rahim Entezari, Sara Hooker, Davide Bacciu, Olga Saukh
Studying the impact of magnitude pruning on contrastive learning methods. CoRR (2022)
Donglin Zhuang, Xingyao Zhang, Shuaiwen Leon Song, Sara Hooker
Randomness In Neural Network Training: Characterizing The Impact of Tooling. CoRR (2021)
Sara Hooker
The hardware lottery. Commun. ACM 64 (12) (2021)
Orevaoghene Ahia, Julia Kreutzer, Sara Hooker
The Low-Resource Double Bind: An Empirical Study of Pruning for Low-Resource Machine Translation. EMNLP (Findings) (2021)
Orevaoghene Ahia, Julia Kreutzer, Sara Hooker
The Low-Resource Double Bind: An Empirical Study of Pruning for Low-Resource Machine Translation. CoRR (2021)
Sara Hooker
Moving beyond "algorithmic bias is a data problem". Patterns 2 (4) (2021)
Niel Teng Hu, Xinyu Hu, Rosanne Liu, Sara Hooker, Jason Yosinski
When does loss-based prioritization fail? CoRR (2021)
Kale-ab Tessera, Sara Hooker, Benjamin Rosman
Keep the Gradients Flowing: Using Gradient Flow to Study Sparse Network Optimization. CoRR (2021)
Daniel D'souza, Zach Nussbaum, Chirag Agarwal, Sara Hooker
A Tale Of Two Long Tails. CoRR (2021)
Chirag Agarwal, Sara Hooker
Estimating Example Difficulty using Variance of Gradients. CoRR (2020)
Sara Hooker
The Hardware Lottery. CoRR (2020)
Miles Brundage, Shahar Avin, Jasmine Wang, Haydn Belfield, Gretchen Krueger, Gillian K. Hadfield, Heidy Khlaaf, Jingying Yang, Helen Toner, Ruth Fong, Tegan Maharaj, Pang Wei Koh, Sara Hooker, Jade Leung, Andrew Trask, Emma Bluemke, Jonathan Lebensold, Cullen O'Keefe, Mark Koren, Théo Ryffel, J. B. Rubinovitz, Tamay Besiroglu, Federica Carugati, Jack Clark, Peter Eckersley, Sarah de Haas, Maritza Johnson, Ben Laurie, Alex Ingerman, Igor Krawczuk, Amanda Askell, Rosario Cammarota, Andrew Lohn, David Krueger, Charlotte Stix, Peter Henderson, Logan Graham, Carina Prunkl, Bianca Martin, Elizabeth Seger, Noa Zilberman, Seán Ó hÉigeartaigh, Frens Kroeger, Girish Sastry, Rebecca Kagan, Adrian Weller, Brian Tse, Elizabeth Barnes, Allan Dafoe, Paul Scharre, Ariel Herbert-Voss, Martijn Rasser, Shagun Sodhani, Carrick Flynn, Thomas Krendl Gilbert, Lisa Dyer, Saif Khan, Yoshua Bengio, Markus Anderljung
Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claims. CoRR (2020)
Sara Hooker, Nyalleng Moorosi, Gregory Clark, Samy Bengio, Emily Denton
Characterising Bias in Compressed Models. CoRR (2020)
Sara Hooker, Aaron C. Courville, Yann N. Dauphin, Andrea Frome
Selective Brain Damage: Measuring the Disparate Impact of Model Pruning. CoRR (2019)
Sara Hooker, Dumitru Erhan, Pieter-Jan Kindermans, Been Kim
A Benchmark for Interpretability Methods in Deep Neural Networks. NeurIPS (2019)
Trevor Gale, Erich Elsen, Sara Hooker
The State of Sparsity in Deep Neural Networks. CoRR (2019)
Sara Hooker, Dumitru Erhan, Pieter-Jan Kindermans, Been Kim
Evaluating Feature Importance Estimates. CoRR (2018)
Pieter-Jan Kindermans, Sara Hooker, Julius Adebayo, Maximilian Alber, Kristof T. Schütt, Sven Dähne, Dumitru Erhan, Been Kim
The (Un)reliability of saliency methods. CoRR (2017)