Szymon Tworkowski

Publication Activity (10 Years)

Years Active: 2021-2024
Publications (10 Years): 12

Top Topics

Automated Theorem Provers

Language Models For Information Retrieval

Document Retrieval

Top Venues

NAACL-HLT (Findings)

Publications

Yu Zhao, Yuanbin Qu, Konrad Staniszewski, Szymon Tworkowski, Wei Liu, Piotr Milos, Yuxiang Wu, Pasquale Minervini
Analysing The Impact of Sequence Composition on Language Model Pre-Training. CoRR (2024)
Maciej Mikula, Szymon Tworkowski, Szymon Antoniak, Bartosz Piotrowski, Albert Q. Jiang, Jin Peng Zhou, Christian Szegedy, Lukasz Kucinski, Piotr Milos, Yuhuai Wu
Magnushammer: A Transformer-Based Approach to Premise Selection. ICLR (2024)
Yu Zhao, Yuanbin Qu, Konrad Staniszewski, Szymon Tworkowski, Wei Liu, Piotr Milos, Yuxiang Wu, Pasquale Minervini
Analysing The Impact of Sequence Composition on Language Model Pre-Training. ACL (1) (2024)
Konrad Staniszewski, Szymon Tworkowski, Sebastian Jaszczur, Henryk Michalewski, Lukasz Kucinski, Piotr Milos
Structured Packing in LLM Training Improves Long Context Utilization. CoRR (2023)
Szymon Tworkowski, Konrad Staniszewski, Mikolaj Pacek, Yuhuai Wu, Henryk Michalewski, Piotr Milos
Focused Transformer: Contrastive Training for Context Scaling. CoRR (2023)
Jierui Li, Szymon Tworkowski, Yingying Wu, Raymond J. Mooney
Explaining Competitive-Level Programming Solutions using LLMs. CoRR (2023)
Szymon Tworkowski, Konrad Staniszewski, Mikolaj Pacek, Yuhuai Wu, Henryk Michalewski, Piotr Milos
Focused Transformer: Contrastive Training for Context Scaling. NeurIPS (2023)
Maciej Mikula, Szymon Antoniak, Szymon Tworkowski, Albert Qiaochu Jiang, Jin Peng Zhou, Christian Szegedy, Lukasz Kucinski, Piotr Milos, Yuhuai Wu
Magnushammer: A Transformer-based Approach to Premise Selection. CoRR (2023)
Albert Qiaochu Jiang, Wenda Li, Szymon Tworkowski, Konrad Czechowski, Tomasz Odrzygózdz, Piotr Milos, Yuhuai Wu, Mateja Jamnik
Thor: Wielding Hammers to Integrate Language Models and Automated Theorem Provers. NeurIPS (2022)
Albert Q. Jiang, Wenda Li, Szymon Tworkowski, Konrad Czechowski, Tomasz Odrzygózdz, Piotr Milos, Yuhuai Wu, Mateja Jamnik
Thor: Wielding Hammers to Integrate Language Models and Automated Theorem Provers. CoRR (2022)
Piotr Nawrot, Szymon Tworkowski, Michal Tyrolski, Lukasz Kaiser, Yuhuai Wu, Christian Szegedy, Henryk Michalewski
Hierarchical Transformers Are More Efficient Language Models. NAACL-HLT (Findings) (2022)
Piotr Nawrot, Szymon Tworkowski, Michal Tyrolski, Lukasz Kaiser, Yuhuai Wu, Christian Szegedy, Henryk Michalewski
Hierarchical Transformers Are More Efficient Language Models. CoRR (2021)