Chiyuan Zhang

Publication Activity (10 Years)

Years Active: 2010-2024
Publications (10 Years): 82

Top Venues

CoRR

NeurIPS

ICLR

ICML

Massachusetts Institute of Technology, Cambridge, USA (PHD)

Education History

Massachusetts Institute of Technology, Cambridge, USA

PHD

Publications

Niklas Stoehr, Mitchell Gordon, Chiyuan Zhang, Owen Lewis
Localizing Paragraph Memorization in Language Models. CoRR (2024)
Badih Ghazi, Pritish Kamath, Ravi Kumar, Pasin Manurangsi, Raghu Meka, Chiyuan Zhang
On Convex Optimization with Semi-Sensitive Features. COLT (2024)
Luxi He, Yangsibo Huang, Weijia Shi, Tinghao Xie, Haotian Liu, Yue Wang, Luke Zettlemoyer, Chiyuan Zhang, Danqi Chen, Peter Henderson
Fantastic Copyrighted Beasts and How (Not) to Generate Them. CoRR (2024)
Lynn Chua, Badih Ghazi, Yangsibo Huang, Pritish Kamath, Daogao Liu, Pasin Manurangsi, Amer Sinha, Chiyuan Zhang
Mind the Privacy Unit! User-Level Differential Privacy for Language Model Fine-Tuning. CoRR (2024)
Lynn Chua, Badih Ghazi, Pritish Kamath, Ravi Kumar, Pasin Manurangsi, Amer Sinha, Chiyuan Zhang
How Private is DP-SGD? CoRR (2024)
Badih Ghazi, Yangsibo Huang, Pritish Kamath, Ravi Kumar, Pasin Manurangsi, Chiyuan Zhang
LabelDP-Pro: Learning with Label Differential Privacy via Projections. ICLR (2024)
Badih Ghazi, Pritish Kamath, Ravi Kumar, Pasin Manurangsi, Raghu Meka, Chiyuan Zhang
On Convex Optimization with Semi-Sensitive Features. CoRR (2024)
Lynn Chua, Qiliang Cui, Badih Ghazi, Charlie Harrison, Pritish Kamath, Walid Krichene, Ravi Kumar, Pasin Manurangsi, Krishna Giri Narra, Amer Sinha, Avinash V. Varadarajan, Chiyuan Zhang
Training Differentially Private Ad Prediction Models with Semi-Sensitive Features. CoRR (2024)
Lynn Chua, Badih Ghazi, Yangsibo Huang, Pritish Kamath, Ravi Kumar, Pasin Manurangsi, Amer Sinha, Chulin Xie, Chiyuan Zhang
Crosslingual Capabilities and Knowledge Barriers in Multilingual Large Language Models. CoRR (2024)
Chiyuan Zhang, Nan Chen, Douming Hu, Fang Zhu, Yuesheng Pu, Libin Yao
, 2.9-μW Pulse-Frequency-Modulation based Temperature Sensor with 40-mK Resolution. ISCAS (2024)
Boyi Wei, Weijia Shi, Yangsibo Huang, Noah A. Smith, Chiyuan Zhang, Luke Zettlemoyer, Kai Li, Peter Henderson
Evaluating Copyright Takedown Methods for Language Models. CoRR (2024)
Weijia Shi, Jaechan Lee, Yangsibo Huang, Sadhika Malladi, Jieyu Zhao, Ari Holtzman, Daogao Liu, Luke Zettlemoyer, Noah A. Smith, Chiyuan Zhang
MUSE: Machine Unlearning Six-Way Evaluation for Language Models. CoRR (2024)
Badih Ghazi, Pritish Kamath, Ravi Kumar, Raghu Meka, Pasin Manurangsi, Chiyuan Zhang
On User-Level Private Convex Optimization. CoRR (2023)
Badih Ghazi, Pritish Kamath, Ravi Kumar, Pasin Manurangsi, Ayush Sekhari, Chiyuan Zhang
Ticketed Learning-Unlearning Schemes. COLT (2023)
Ashwinkumar Badanidiyuru Varadaraja, Badih Ghazi, Pritish Kamath, Ravi Kumar, Ethan Leeman, Pasin Manurangsi, Avinash V. Varadarajan, Chiyuan Zhang
Optimal Unbiased Randomizers for Regression with Label Differential Privacy. NeurIPS (2023)
Carson Denison, Badih Ghazi, Pritish Kamath, Ravi Kumar, Pasin Manurangsi, Krishna Giri Narra, Amer Sinha, Avinash V. Varadarajan, Chiyuan Zhang
Private Ad Modeling with DP-SGD. AdKDD@KDD (2023)
Chiyuan Zhang, Daphne Ippolito, Katherine Lee, Matthew Jagielski, Florian Tramèr, Nicholas Carlini
Counterfactual Memorization in Neural Language Models. NeurIPS (2023)
Badih Ghazi, Pritish Kamath, Ravi Kumar, Ethan Leeman, Pasin Manurangsi, Avinash Varadarajan, Chiyuan Zhang
Regression with Label Differential Privacy. ICLR (2023)
Badih Ghazi, Pritish Kamath, Ravi Kumar, Pasin Manurangsi, Raghu Meka, Chiyuan Zhang
On User-Level Private Convex Optimization. ICML (2023)
Badih Ghazi, Yangsibo Huang, Pritish Kamath, Ravi Kumar, Pasin Manurangsi, Amer Sinha, Chiyuan Zhang
Sparsity-Preserving Differentially Private Training of Large Embedding Models. NeurIPS (2023)
Pratyush Maini, Michael Curtis Mozer, Hanie Sedghi, Zachary Chase Lipton, J. Zico Kolter, Chiyuan Zhang
Can Neural Network Memorization Be Localized? ICML (2023)
Daphne Ippolito, Florian Tramèr, Milad Nasr, Chiyuan Zhang, Matthew Jagielski, Katherine Lee, Christopher A. Choquette-Choo, Nicholas Carlini
Preventing Generation of Verbatim Memorization in Language Models Gives a False Sense of Privacy. INLG (2023)
Badih Ghazi, Pritish Kamath, Ravi Kumar, Pasin Manurangsi, Raghu Meka, Chiyuan Zhang
User-Level Differential Privacy With Few Examples Per User. CoRR (2023)
Nicholas Carlini, Daphne Ippolito, Matthew Jagielski, Katherine Lee, Florian Tramèr, Chiyuan Zhang
Quantifying Memorization Across Neural Language Models. ICLR (2023)
Badih Ghazi, Pritish Kamath, Ravi Kumar, Pasin Manurangsi, Ayush Sekhari, Chiyuan Zhang
Ticketed Learning-Unlearning Schemes. CoRR (2023)
Pratyush Maini, Michael C. Mozer, Hanie Sedghi, Zachary C. Lipton, J. Zico Kolter, Chiyuan Zhang
Can Neural Network Memorization Be Localized? CoRR (2023)
Badih Ghazi, Pritish Kamath, Ravi Kumar, Pasin Manurangsi, Raghu Meka, Chiyuan Zhang
User-Level Differential Privacy With Few Examples Per User. NeurIPS (2023)
Badih Ghazi, Yangsibo Huang, Pritish Kamath, Ravi Kumar, Pasin Manurangsi, Amer Sinha, Chiyuan Zhang
Sparsity-Preserving Differentially Private Training of Large Embedding Models. CoRR (2023)
Matthew Jagielski, Om Thakkar, Florian Tramèr, Daphne Ippolito, Katherine Lee, Nicholas Carlini, Eric Wallace, Shuang Song, Abhradeep Guha Thakurta, Nicolas Papernot, Chiyuan Zhang
Measuring Forgetting of Memorized Training Examples. ICLR (2023)
Ashwinkumar Badanidiyuru, Badih Ghazi, Pritish Kamath, Ravi Kumar, Ethan Leeman, Pasin Manurangsi, Avinash V. Varadarajan, Chiyuan Zhang
Optimal Unbiased Randomizers for Regression with Label Differential Privacy. CoRR (2023)
Nicholas Carlini, Matthew Jagielski, Chiyuan Zhang, Nicolas Papernot, Andreas Terzis, Florian Tramèr
The Privacy Onion Effect: Memorization is Relative. NeurIPS (2022)
Matthew Jagielski, Om Thakkar, Florian Tramèr, Daphne Ippolito, Katherine Lee, Nicholas Carlini, Eric Wallace, Shuang Song, Abhradeep Thakurta, Nicolas Papernot, Chiyuan Zhang
Measuring Forgetting of Memorized Training Examples. CoRR (2022)
Weiyan Shi, Si Chen, Chiyuan Zhang, Ruoxi Jia, Zhou Yu
Just Fine-tune Twice: Selective Differential Privacy for Large Language Models. CoRR (2022)
Yao Qin, Chiyuan Zhang, Ting Chen, Balaji Lakshminarayanan, Alex Beutel, Xuezhi Wang
Understanding and Improving Robustness of Vision Transformers through Patch-based Negative Augmentation. NeurIPS (2022)
Emmanuel Abbe, Samy Bengio, Elisabetta Cornacchia, Jon M. Kleinberg, Aryo Lotfi, Maithra Raghu, Chiyuan Zhang
Learning to Reason with Neural Networks: Generalization, Unseen Data and Boolean Measures. CoRR (2022)
Chiyuan Zhang, Samy Bengio, Yoram Singer
Are All Layers Created Equal? J. Mach. Learn. Res. 23 (2022)
Katherine Lee, Daphne Ippolito, Andrew Nystrom, Chiyuan Zhang, Douglas Eck, Chris Callison-Burch, Nicholas Carlini
Deduplicating Training Data Makes Language Models Better. ACL (1) (2022)
Nicholas Carlini, Daphne Ippolito, Matthew Jagielski, Katherine Lee, Florian Tramèr, Chiyuan Zhang
Quantifying Memorization Across Neural Language Models. CoRR (2022)
Badih Ghazi, Pritish Kamath, Ravi Kumar, Ethan Leeman, Pasin Manurangsi, Avinash Varadarajan, Chiyuan Zhang
Regression with Label Differential Privacy. CoRR (2022)
Emmanuel Abbe, Samy Bengio, Elisabetta Cornacchia, Jon M. Kleinberg, Aryo Lotfi, Maithra Raghu, Chiyuan Zhang
Learning to Reason with Neural Networks: Generalization, Unseen Data and Boolean Measures. NeurIPS (2022)
Weiyan Shi, Ryan Shea, Si Chen, Chiyuan Zhang, Ruoxi Jia, Zhou Yu
Just Fine-tune Twice: Selective Differential Privacy for Large Language Models. EMNLP (2022)
Carson Denison, Badih Ghazi, Pritish Kamath, Ravi Kumar, Pasin Manurangsi, Krishna Giri Narra, Amer Sinha, Avinash Varadarajan, Chiyuan Zhang
Private Ad Modeling with DP-SGD. CoRR (2022)
Nicholas Carlini, Matthew Jagielski, Chiyuan Zhang, Nicolas Papernot, Andreas Terzis, Florian Tramèr
The Privacy Onion Effect: Memorization is Relative. CoRR (2022)
Daphne Ippolito, Florian Tramèr, Milad Nasr, Chiyuan Zhang, Matthew Jagielski, Katherine Lee, Christopher A. Choquette-Choo, Nicholas Carlini
Preventing Verbatim Memorization in Language Models Gives a False Sense of Privacy. CoRR (2022)
Maithra Raghu, Thomas Unterthiner, Simon Kornblith, Chiyuan Zhang, Alexey Dosovitskiy
Do Vision Transformers See Like Convolutional Neural Networks? CoRR (2021)
Yao Qin, Chiyuan Zhang, Ting Chen, Balaji Lakshminarayanan, Alex Beutel, Xuezhi Wang
Understanding and Improving Robustness of Vision Transformers through Patch-based Negative Augmentation. CoRR (2021)
Piotr Teterwak, Chiyuan Zhang, Dilip Krishnan, Michael C. Mozer
Understanding Invariance via Feedforward Inversion of Discriminatively Trained Classifiers. ICML (2021)
Chiyuan Zhang, Daphne Ippolito, Katherine Lee, Matthew Jagielski, Florian Tramèr, Nicholas Carlini
Counterfactual Memorization in Neural Language Models. CoRR (2021)
Badih Ghazi, Noah Golowich, Ravi Kumar, Pasin Manurangsi, Chiyuan Zhang
On Deep Learning with Label Differential Privacy. CoRR (2021)
Chiyuan Zhang, Maithra Raghu, Jon M. Kleinberg, Samy Bengio
Pointer Value Retrieval: A new benchmark for understanding the limits of neural network generalization. CoRR (2021)
Maithra Raghu, Thomas Unterthiner, Simon Kornblith, Chiyuan Zhang, Alexey Dosovitskiy
Do Vision Transformers See Like Convolutional Neural Networks? NeurIPS (2021)
Katherine Lee, Daphne Ippolito, Andrew Nystrom, Chiyuan Zhang, Douglas Eck, Chris Callison-Burch, Nicholas Carlini
Deduplicating Training Data Makes Language Models Better. CoRR (2021)
Piotr Teterwak, Chiyuan Zhang, Dilip Krishnan, Michael C. Mozer
Understanding invariance via feedforward inversion of discriminatively trained classifiers. CoRR (2021)
Ziheng Jiang, Chiyuan Zhang, Kunal Talwar, Michael C. Mozer
Characterizing Structural Regularities of Labeled Data in Overparameterized Models. ICML (2021)
Chiyuan Zhang, Samy Bengio, Moritz Hardt, Benjamin Recht, Oriol Vinyals
Understanding deep learning (still) requires rethinking generalization. Commun. ACM 64 (3) (2021)
Badih Ghazi, Noah Golowich, Ravi Kumar, Pasin Manurangsi, Chiyuan Zhang
Deep Learning with Label Differential Privacy. NeurIPS (2021)
Vitaly Feldman, Chiyuan Zhang
What Neural Networks Memorize and Why: Discovering the Long Tail via Influence Estimation. CoRR (2020)
Chiyuan Zhang, Samy Bengio, Moritz Hardt, Michael C. Mozer, Yoram Singer
Identity Crisis: Memorization and Generalization Under Extreme Overparameterization. ICLR (2020)
Behnam Neyshabur, Hanie Sedghi, Chiyuan Zhang
What is being transferred in transfer learning? CoRR (2020)
Ziheng Jiang, Chiyuan Zhang, Kunal Talwar, Michael C. Mozer
Exploring the Memorization-Generalization Continuum in Deep Learning. CoRR (2020)
Behnam Neyshabur, Hanie Sedghi, Chiyuan Zhang
What is being transferred in transfer learning? NeurIPS (2020)
Vitaly Feldman, Chiyuan Zhang
What Neural Networks Memorize and Why: Discovering the Long Tail via Influence Estimation. NeurIPS (2020)
Chiyuan Zhang, Samy Bengio, Yoram Singer
Are All Layers Created Equal? CoRR (2019)
Chiyuan Zhang, Samy Bengio, Moritz Hardt, Yoram Singer
Identity Crisis: Memorization and Generalization under Extreme Overparameterization. CoRR (2019)
Qihao Wan, Jiaxin Zhao, Jianru Xue, Chiyuan Zhang, Bin He, Heming Zhang
A Novel Hierarchical Collaborative Method Based on Multi-objective Optimization for Modularization of Product Platform. CSCWD (2019)
Maithra Raghu, Chiyuan Zhang, Jon M. Kleinberg, Samy Bengio
Transfusion: Understanding Transfer Learning with Applications to Medical Imaging. CoRR (2019)
Maithra Raghu, Chiyuan Zhang, Jon M. Kleinberg, Samy Bengio
Transfusion: Understanding Transfer Learning for Medical Imaging. NeurIPS (2019)
Chiyuan Zhang, Qianli Liao, Alexander Rakhlin, Brando Miranda, Noah Golowich, Tomaso A. Poggio
Theory of Deep Learning IIb: Optimization Properties of SGD. CoRR (2018)
Neil C. Rabinowitz, Frank Perbet, H. Francis Song, Chiyuan Zhang, S. M. Ali Eslami, Matthew Botvinick
Machine Theory of Mind. ICML (2018)
Chiyuan Zhang, Oriol Vinyals, Rémi Munos, Samy Bengio
A Study on Overfitting in Deep Reinforcement Learning. CoRR (2018)
Tom B. Brown, Nicholas Carlini, Chiyuan Zhang, Catherine Olsson, Paul F. Christiano, Ian J. Goodfellow
Unrestricted Adversarial Examples. CoRR (2018)
Neil C. Rabinowitz, Frank Perbet, H. Francis Song, Chiyuan Zhang, S. M. Ali Eslami, Matthew Botvinick
Machine Theory of Mind. CoRR (2018)
Yuqi Guo, Yangzhou Chen, Chiyuan Zhang
Decentralized State-Observer-Based Traffic Density Estimation of Large-Scale Urban Freeway Network by Dynamic Model. Inf. 8 (3) (2017)
Chiyuan Zhang, Samy Bengio, Moritz Hardt, Benjamin Recht, Oriol Vinyals
Understanding deep learning requires rethinking generalization. ICLR (2017)
Yuqi Guo, Yangzhou Chen, Wei Li, Chiyuan Zhang
Distributed state-observer-based traffic density estimation of urban freeway network. ITSC (2017)
Tianqi Chen, Bing Xu, Chiyuan Zhang, Carlos Guestrin
Training Deep Nets with Sublinear Memory Cost. CoRR (2016)
Xiaofei He, Chiyuan Zhang, Lijun Zhang, Xuelong Li
A-Optimal Projection for Image Representation. IEEE Trans. Pattern Anal. Mach. Intell. 38 (5) (2016)
Chiyuan Zhang, Samy Bengio, Moritz Hardt, Benjamin Recht, Oriol Vinyals
Understanding deep learning requires rethinking generalization. CoRR (2016)
Charlie Frogner, Chiyuan Zhang, Hossein Mobahi, Mauricio Araya-Polo, Tomaso A. Poggio
Learning with a Wasserstein Loss. CoRR (2015)
Charlie Frogner, Chiyuan Zhang, Hossein Mobahi, Mauricio Araya-Polo, Tomaso A. Poggio
Learning with a Wasserstein Loss. NIPS (2015)
Chiyuan Zhang, Stephen Voinea, Georgios Evangelopoulos, Lorenzo Rosasco, Tomaso A. Poggio
Discriminative template learning in group-convolutional networks for invariant speech representations. INTERSPEECH (2015)
Tianqi Chen, Mu Li, Yutian Li, Min Lin, Naiyan Wang, Minjie Wang, Tianjun Xiao, Bing Xu, Chiyuan Zhang, Zheng Zhang
MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems. CoRR (2015)
Chiyuan Zhang, Stephen Voinea, Georgios Evangelopoulos, Lorenzo Rosasco, Tomaso A. Poggio
Phone classification by a hierarchy of invariant representation layers. INTERSPEECH (2014)
Chiyuan Zhang, Georgios Evangelopoulos, Stephen Voinea, Lorenzo Rosasco, Tomaso A. Poggio
A deep representation for invariance and music classification. ICASSP (2014)
Chiyuan Zhang, Georgios Evangelopoulos, Stephen Voinea, Lorenzo Rosasco, Tomaso A. Poggio
A Deep Representation for Invariance And Music Classification. CoRR (2014)
Georgios Evangelopoulos, Stephen Voinea, Chiyuan Zhang, Lorenzo Rosasco, Tomaso A. Poggio
Learning An Invariant Speech Representation. CoRR (2014)
Stephen Voinea, Chiyuan Zhang, Georgios Evangelopoulos, Lorenzo Rosasco, Tomaso A. Poggio
Word-level invariant representations from acoustic waveforms. INTERSPEECH (2014)
Chiyuan Zhang, Ming Ji
Combining Active and Semi-Supervised Learning for Video Compression. Int. J. Softw. Informatics 7 (3) (2013)
Binbin Lin, Xiaofei He, Chiyuan Zhang, Ming Ji
Parallel vector field embedding. J. Mach. Learn. Res. 14 (1) (2013)
Chiyuan Zhang, Xiaofei He
Image Compression by Learning to Minimize the Total Error. IEEE Trans. Circuits Syst. Video Technol. 23 (4) (2013)
Binbin Lin, Sen Yang, Chiyuan Zhang, Jieping Ye, Xiaofei He
Multi-task Vector Field Learning. NIPS (2012)
Binbin Lin, Chiyuan Zhang, Xiaofei He
Semi-supervised Regression via Parallel Field Regularization. NIPS (2011)
Xiaofei He, Ming Ji, Chiyuan Zhang, Hujun Bao
A Variance Minimization Criterion to Feature Selection Using Laplacian Regularization. IEEE Trans. Pattern Anal. Mach. Intell. 33 (10) (2011)
Binbin Lin, Chiyuan Zhang, Xiaofei He
Orthogonal Projection Analysis. IScIDE (2011)
Deng Cai, Chiyuan Zhang, Xiaofei He
Unsupervised feature selection for multi-cluster data. KDD (2010)

Chiyuan Zhang.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

Chiyuan Zhang