Daniel Simig

Publication Activity (10 Years)

Years Active: 2021-2023
Publications (10 Years): 16

Top Topics

Cf Loadingtexthtml

Efficient Learning

Multiscale Representation

Top Venues

Publications

Kushal Tirumala, Daniel Simig, Armen Aghajanyan, Ari S. Morcos
D4: Improving LLM Pretraining via Document De-Duplication and Diversification. CoRR (2023)
Lili Yu, Daniel Simig, Colin Flaherty, Armen Aghajanyan, Luke Zettlemoyer, Mike Lewis
MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers. CoRR (2023)
Xiaochuang Han, Daniel Simig, Todor Mihaylov, Yulia Tsvetkov, Asli Celikyilmaz, Tianlu Wang
Understanding In-Context Learning via Supportive Pretraining Data. ACL (1) (2023)
Lili Yu, Daniel Simig, Colin Flaherty, Armen Aghajanyan, Luke Zettlemoyer, Mike Lewis
MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers. NeurIPS (2023)
Kushal Tirumala, Daniel Simig, Armen Aghajanyan, Ari Morcos
D4: Improving LLM Pretraining via Document De-Duplication and Diversification. NeurIPS (2023)
Xiaochuang Han, Daniel Simig, Todor Mihaylov, Yulia Tsvetkov, Asli Celikyilmaz, Tianlu Wang
Understanding In-Context Learning via Supportive Pretraining Data. CoRR (2023)
Amro Abbas, Kushal Tirumala, Daniel Simig, Surya Ganguli, Ari S. Morcos
SemDeDup: Data-efficient learning at web-scale through semantic deduplication. CoRR (2023)
Sebastian Cadavid-Sanchez, Khalil Kacem, Rafael Aparecido Martins Frade, Johannes Boehm, Thomas Chaney, Danial Lashkari, Daniel Simig
Evaluating end-to-end entity linking on domain-specific knowledge bases: Learning about ancient technologies from museum collections. CoRR (2023)
Daniel Simig, Tianlu Wang, Verna Dankers, Peter Henderson, Khuyagbaatar Batsuren, Dieuwke Hupkes, Mona T. Diab
Text Characterization Toolkit. CoRR (2022)
Susan Zhang, Stephen Roller, Naman Goyal, Mikel Artetxe, Moya Chen, Shuohui Chen, Christopher Dewan, Mona T. Diab, Xian Li, Xi Victoria Lin, Todor Mihaylov, Myle Ott, Sam Shleifer, Kurt Shuster, Daniel Simig, Punit Singh Koura, Anjali Sridhar, Tianlu Wang, Luke Zettlemoyer
OPT: Open Pre-trained Transformer Language Models. CoRR (2022)
Daniel Simig, Fabio Petroni, Pouya Yanki, Kashyap Popat, Christina Du, Sebastian Riedel, Majid Yazdani
Open Vocabulary Extreme Classification Using Generative Models. CoRR (2022)
Daniel Simig, Fabio Petroni, Pouya Yanki, Kashyap Popat, Christina Du, Sebastian Riedel, Majid Yazdani
Open Vocabulary Extreme Classification Using Generative Models. ACL (Findings) (2022)
Xi Victoria Lin, Todor Mihaylov, Mikel Artetxe, Tianlu Wang, Shuohui Chen, Daniel Simig, Myle Ott, Naman Goyal, Shruti Bhosale, Jingfei Du, Ramakanth Pasunuru, Sam Shleifer, Punit Singh Koura, Vishrav Chaudhary, Brian O'Horo, Jeff Wang, Luke Zettlemoyer, Zornitsa Kozareva, Mona Diab, Veselin Stoyanov, Xian Li
Few-shot Learning with Multilingual Generative Language Models. EMNLP (2022)
Daniel Simig, Tianlu Wang, Verna Dankers, Peter Henderson, Khuyagbaatar Batsuren, Dieuwke Hupkes, Mona T. Diab
Text Characterization Toolkit (TCT). AACL/IJCNLP (System Demonstrations) (2022)
Srinivasan Iyer, Xi Victoria Lin, Ramakanth Pasunuru, Todor Mihaylov, Daniel Simig, Ping Yu, Kurt Shuster, Tianlu Wang, Qing Liu, Punit Singh Koura, Xian Li, Brian O'Horo, Gabriel Pereyra, Jeff Wang, Christopher Dewan, Asli Celikyilmaz, Luke Zettlemoyer, Ves Stoyanov
OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalization. CoRR (2022)
Xi Victoria Lin, Todor Mihaylov, Mikel Artetxe, Tianlu Wang, Shuohui Chen, Daniel Simig, Myle Ott, Naman Goyal, Shruti Bhosale, Jingfei Du, Ramakanth Pasunuru, Sam Shleifer, Punit Singh Koura, Vishrav Chaudhary, Brian O'Horo, Jeff Wang, Luke Zettlemoyer, Zornitsa Kozareva, Mona T. Diab, Veselin Stoyanov, Xian Li
Few-shot Learning with Multilingual Language Models. CoRR (2021)