Piotr Nawrot

Publication Activity (10 Years)

Years Active: 2021-2024
Publications (10 Years): 8

Top Topics

Language Modelling

Document Retrieval

Limited Resources

Top Venues

NAACL-HLT (Findings)

Publications

Piotr Nawrot, Adrian Lancucki, Marcin Chochowski, David Tarjan, Edoardo M. Ponti
Dynamic Memory Compression: Retrofitting LLMs for Accelerated Inference. CoRR (2024)
Piotr Nawrot
nanoT5: A PyTorch Framework for Pre-training and Fine-tuning T5-style Models with Limited Resources. CoRR (2023)
Jean Kaddour, Oscar Key, Piotr Nawrot, Pasquale Minervini, Matt J. Kusner
No Train No Gain: Revisiting Efficient Training Algorithms For Transformer-based Language Models. NeurIPS (2023)
Jean Kaddour, Oscar Key, Piotr Nawrot, Pasquale Minervini, Matt J. Kusner
No Train No Gain: Revisiting Efficient Training Algorithms For Transformer-based Language Models. CoRR (2023)
Piotr Nawrot, Jan Chorowski, Adrian Lancucki, Edoardo Maria Ponti
Efficient Transformers with Dynamic Token Pooling. ACL (1) (2023)
Piotr Nawrot, Jan Chorowski, Adrian Lancucki, Edoardo M. Ponti
Efficient Transformers with Dynamic Token Pooling. CoRR (2022)
Piotr Nawrot, Szymon Tworkowski, Michal Tyrolski, Lukasz Kaiser, Yuhuai Wu, Christian Szegedy, Henryk Michalewski
Hierarchical Transformers Are More Efficient Language Models. NAACL-HLT (Findings) (2022)
Piotr Nawrot, Szymon Tworkowski, Michal Tyrolski, Lukasz Kaiser, Yuhuai Wu, Christian Szegedy, Henryk Michalewski
Hierarchical Transformers Are More Efficient Language Models. CoRR (2021)