Lukasz Kaiser

ORCID

Publication Activity (10 Years)

Years Active: 2005-2022
Publications (10 Years): 53

Top Venues

RWTH Aachen University, Germany (PHD)

Education History

RWTH Aachen University, Germany

PHD

Publications

Piotr Kozakowski, Lukasz Kaiser, Henryk Michalewski, Afroz Mohiuddin, Katarzyna Kanska
Q-Value Weighted Regression: Reinforcement Learning with Limited Data. IJCNN (2022)
Piotr Nawrot, Szymon Tworkowski, Michal Tyrolski, Lukasz Kaiser, Yuhuai Wu, Christian Szegedy, Henryk Michalewski
Hierarchical Transformers Are More Efficient Language Models. NAACL-HLT (Findings) (2022)
Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de Oliveira Pinto, Jared Kaplan, Harrison Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, Alex Ray, Raul Puri, Gretchen Krueger, Michael Petrov, Heidy Khlaaf, Girish Sastry, Pamela Mishkin, Brooke Chan, Scott Gray, Nick Ryder, Mikhail Pavlov, Alethea Power, Lukasz Kaiser, Mohammad Bavarian, Clemens Winter, Philippe Tillet, Felipe Petroski Such, Dave Cummings, Matthias Plappert, Fotios Chantzis, Elizabeth Barnes, Ariel Herbert-Voss, William Hebgen Guss, Alex Nichol, Alex Paino, Nikolas Tezak, Jie Tang, Igor Babuschkin, Suchir Balaji, Shantanu Jain, William Saunders, Christopher Hesse, Andrew N. Carr, Jan Leike, Joshua Achiam, Vedant Misra, Evan Morikawa, Alec Radford, Matthew Knight, Miles Brundage, Mira Murati, Katie Mayer, Peter Welinder, Bob McGrew, Dario Amodei, Sam McCandlish, Ilya Sutskever, Wojciech Zaremba
Evaluating Large Language Models Trained on Code. CoRR (2021)
Piotr Nawrot, Szymon Tworkowski, Michal Tyrolski, Lukasz Kaiser, Yuhuai Wu, Christian Szegedy, Henryk Michalewski
Hierarchical Transformers Are More Efficient Language Models. CoRR (2021)
Krzysztof Marcin Choromanski, Valerii Likhosherstov, David Dohan, Xingyou Song, Andreea Gane, Tamás Sarlós, Peter Hawkins, Jared Quincy Davis, Afroz Mohiuddin, Lukasz Kaiser, David Benjamin Belanger, Lucy J. Colwell, Adrian Weller
Rethinking Attention with Performers. ICLR (2021)
Piotr Kozakowski, Lukasz Kaiser, Henryk Michalewski, Afroz Mohiuddin, Katarzyna Kanska
Q-Value Weighted Regression: Reinforcement Learning with Limited Data. CoRR (2021)
Sebastian Jaszczur, Aakanksha Chowdhery, Afroz Mohiuddin, Lukasz Kaiser, Wojciech Gajewski, Henryk Michalewski, Jonni Kanerva
Sparse is Enough in Scaling Transformers. CoRR (2021)
Sebastian Jaszczur, Aakanksha Chowdhery, Afroz Mohiuddin, Lukasz Kaiser, Wojciech Gajewski, Henryk Michalewski, Jonni Kanerva
Sparse is Enough in Scaling Transformers. NeurIPS (2021)
Nikita Kitaev, Lukasz Kaiser, Anselm Levskaya
Reformer: The Efficient Transformer. CoRR (2020)
Lukasz Kaiser, Mohammad Babaeizadeh, Piotr Milos, Blazej Osinski, Roy H. Campbell, Konrad Czechowski, Dumitru Erhan, Chelsea Finn, Piotr Kozakowski, Sergey Levine, Afroz Mohiuddin, Ryan Sepassi, George Tucker, Henryk Michalewski
Model Based Reinforcement Learning for Atari. ICLR (2020)
Nikita Kitaev, Lukasz Kaiser, Anselm Levskaya
Reformer: The Efficient Transformer. ICLR (2020)
Krzysztof Choromanski, Valerii Likhosherstov, David Dohan, Xingyou Song, Andreea Gane, Tamás Sarlós, Peter Hawkins, Jared Davis, Afroz Mohiuddin, Lukasz Kaiser, David Belanger, Lucy J. Colwell, Adrian Weller
Rethinking Attention with Performers. CoRR (2020)
Lukasz Kaiser, Mohammad Babaeizadeh, Piotr Milos, Blazej Osinski, Roy H. Campbell, Konrad Czechowski, Dumitru Erhan, Chelsea Finn, Piotr Kozakowski, Sergey Levine, Ryan Sepassi, George Tucker, Henryk Michalewski
Model-Based Reinforcement Learning for Atari. CoRR (2019)
Daniel Duckworth, Arvind Neelakantan, Ben Goodrich, Lukasz Kaiser, Samy Bengio
Parallel Scheduled Sampling. CoRR (2019)
Yang Li, Lukasz Kaiser, Samy Bengio, Si Si
Area Attention. ICML (2019)
Mostafa Dehghani, Stephan Gouws, Oriol Vinyals, Jakob Uszkoreit, Lukasz Kaiser
Universal Transformers. ICLR (Poster) (2019)
Urvashi Khandelwal, Kevin Clark, Dan Jurafsky, Lukasz Kaiser
Sample Efficient Text Summarization Using a Single Pre-Trained Transformer. CoRR (2019)
Lukasz Kaiser, Aurko Roy, Ashish Vaswani, Niki Parmar, Samy Bengio, Jakob Uszkoreit, Noam Shazeer
Fast Decoding in Sequence Models using Discrete Latent Variables. CoRR (2018)
Lukasz Kaiser, Samy Bengio
Discrete Autoencoders for Sequence Models. CoRR (2018)
Niki Parmar, Ashish Vaswani, Jakob Uszkoreit, Lukasz Kaiser, Noam Shazeer, Alexander Ku
Image Transformer. CoRR (2018)
Yang Li, Lukasz Kaiser, Samy Bengio, Si Si
Area Attention. CoRR (2018)
Aidan N. Gomez, Sicong Huang, Ivan Zhang, Bryan M. Li, Muhammad Osama, Lukasz Kaiser
Unsupervised Cipher Cracking Using Discrete GANs. CoRR (2018)
Lukasz Kaiser, Aidan N. Gomez, François Chollet
Depthwise Separable Convolutions for Neural Machine Translation. ICLR (Poster) (2018)
Lukasz Kaiser, Samy Bengio, Aurko Roy, Ashish Vaswani, Niki Parmar, Jakob Uszkoreit, Noam Shazeer
Fast Decoding in Sequence Models Using Discrete Latent Variables. ICML (2018)
Peter J. Liu, Mohammad Saleh, Etienne Pot, Ben Goodrich, Ryan Sepassi, Lukasz Kaiser, Noam Shazeer
Generating Wikipedia by Summarizing Long Sequences. CoRR (2018)
Ashish Vaswani, Samy Bengio, Eugene Brevdo, François Chollet, Aidan N. Gomez, Stephan Gouws, Llion Jones, Lukasz Kaiser, Nal Kalchbrenner, Niki Parmar, Ryan Sepassi, Noam Shazeer, Jakob Uszkoreit
Tensor2Tensor for Neural Machine Translation. CoRR (2018)
Mostafa Dehghani, Stephan Gouws, Oriol Vinyals, Jakob Uszkoreit, Lukasz Kaiser
Universal Transformers. CoRR (2018)
Aidan N. Gomez, Sicong Huang, Ivan Zhang, Bryan M. Li, Muhammad Osama, Lukasz Kaiser
Unsupervised Cipher Cracking Using Discrete GANs. ICLR (Poster) (2018)
Niki Parmar, Ashish Vaswani, Jakob Uszkoreit, Lukasz Kaiser, Noam Shazeer, Alexander Ku, Dustin Tran
Image Transformer. ICML (2018)
Peter J. Liu, Mohammad Saleh, Etienne Pot, Ben Goodrich, Ryan Sepassi, Lukasz Kaiser, Noam Shazeer
Generating Wikipedia by Summarizing Long Sequences. ICLR (Poster) (2018)
Mia Xu Chen, Orhan Firat, Ankur Bapna, Melvin Johnson, Wolfgang Macherey, George F. Foster, Llion Jones, Mike Schuster, Noam Shazeer, Niki Parmar, Ashish Vaswani, Jakob Uszkoreit, Lukasz Kaiser, Zhifeng Chen, Yonghui Wu, Macduff Hughes
The Best of Both Worlds: Combining Recent Advances in Neural Machine Translation. ACL (1) (2018)
Ashish Vaswani, Samy Bengio, Eugene Brevdo, François Chollet, Aidan N. Gomez, Stephan Gouws, Llion Jones, Lukasz Kaiser, Nal Kalchbrenner, Niki Parmar, Ryan Sepassi, Noam Shazeer, Jakob Uszkoreit
Tensor2Tensor for Neural Machine Translation. AMTA (1) (2018)
Gabriel Pereyra, George Tucker, Jan Chorowski, Lukasz Kaiser, Geoffrey E. Hinton
Regularizing Neural Networks by Penalizing Confident Output Distributions. CoRR (2017)
Lukasz Kaiser, Aidan N. Gomez, François Chollet
Depthwise Separable Convolutions for Neural Machine Translation. CoRR (2017)
Gabriel Pereyra, George Tucker, Jan Chorowski, Lukasz Kaiser, Geoffrey E. Hinton
Regularizing Neural Networks by Penalizing Confident Output Distributions. ICLR (Workshop) (2017)
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin
Attention is All you Need. NIPS (2017)
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin
Attention Is All You Need. CoRR (2017)
Lukasz Kaiser, Aidan N. Gomez, Noam Shazeer, Ashish Vaswani, Niki Parmar, Llion Jones, Jakob Uszkoreit
One Model To Learn Them All. CoRR (2017)
Lukasz Kaiser, Ofir Nachum, Aurko Roy, Samy Bengio
Learning to Remember Rare Events. CoRR (2017)
Lukasz Kaiser, Ofir Nachum, Aurko Roy, Samy Bengio
Learning to Remember Rare Events. ICLR (Poster) (2017)
Yonghui Wu, Mike Schuster, Zhifeng Chen, Quoc V. Le, Mohammad Norouzi, Wolfgang Macherey, Maxim Krikun, Yuan Cao, Qin Gao, Klaus Macherey, Jeff Klingner, Apurva Shah, Melvin Johnson, Xiaobing Liu, Lukasz Kaiser, Stephan Gouws, Yoshikiyo Kato, Taku Kudo, Hideto Kazawa, Keith Stevens, George Kurian, Nishant Patil, Wei Wang, Cliff Young, Jason Smith, Jason Riesa, Alex Rudnick, Oriol Vinyals, Greg Corrado, Macduff Hughes, Jeffrey Dean
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation. CoRR (2016)
Martín Abadi, Ashish Agarwal, Paul Barham, Eugene Brevdo, Zhifeng Chen, Craig Citro, Gregory S. Corrado, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Ian J. Goodfellow, Andrew Harp, Geoffrey Irving, Michael Isard, Yangqing Jia, Rafal Józefowicz, Lukasz Kaiser, Manjunath Kudlur, Josh Levenberg, Dan Mané, Rajat Monga, Sherry Moore, Derek Gordon Murray, Chris Olah, Mike Schuster, Jonathon Shlens, Benoit Steiner, Ilya Sutskever, Kunal Talwar, Paul A. Tucker, Vincent Vanhoucke, Vijay Vasudevan, Fernanda B. Viégas, Oriol Vinyals, Pete Warden, Martin Wattenberg, Martin Wicke, Yuan Yu, Xiaoqiang Zheng
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems. CoRR (2016)
Lukasz Kaiser, Ilya Sutskever
Neural GPUs Learn Algorithms. ICLR (Poster) (2016)
Minh-Thang Luong, Quoc V. Le, Ilya Sutskever, Oriol Vinyals, Lukasz Kaiser
Multi-task Sequence to Sequence Learning. ICLR (Poster) (2016)
Lukasz Kaiser, Samy Bengio
Can Active Memory Replace Attention? NIPS (2016)
Lukasz Kaiser, Samy Bengio
Can Active Memory Replace Attention? CoRR (2016)
Charles Jordan, Lukasz Kaiser
Machine Learning with Guarantees using Descriptive Complexity and SMT Solvers. CoRR (2016)
Oriol Vinyals, Lukasz Kaiser, Terry Koo, Slav Petrov, Ilya Sutskever, Geoffrey E. Hinton
Grammar as a Foreign Language. NIPS (2015)
Arvind Neelakantan, Luke Vilnis, Quoc V. Le, Ilya Sutskever, Lukasz Kaiser, Karol Kurach, James Martens
Adding Gradient Noise Improves Learning for Very Deep Networks. CoRR (2015)
Saeed Akhoondian Amiri, Lukasz Kaiser, Stephan Kreutzer, Roman Rabinovich, Sebastian Siebertz
Graph Searching Games and Width Measures for Directed Graphs. STACS (2015)
Erich Grädel, Wied Pakusa, Svenja Schalthöfer, Lukasz Kaiser
Characterising Choiceless Polynomial Time with First-Order Interpretations. LICS (2015)
Lukasz Kaiser, Martin Lang, Simon Leßenich, Christof Löding
A Unified Approach to Boundedness Properties in MSO. CSL (2015)
Katja Filippova, Enrique Alfonseca, Carlos A. Colmenares, Lukasz Kaiser, Oriol Vinyals
Sentence Compression by Deletion with LSTMs. EMNLP (2015)
Charles Jordan, Lukasz Kaiser, Florian Lonsing, Martina Seidl
MPIDepQBF: Towards Parallel QBF Solving without Knowledge Sharing. SAT (2014)
Faried Abu Zaid, Erich Grädel, Lukasz Kaiser, Wied Pakusa
Model-Theoretic Properties of ω-Automatic Structures. Theory Comput. Syst. 55 (4) (2014)
Lukasz Kaiser, Stephan Kreutzer, Roman Rabinovich, Sebastian Siebertz
Directed Width Measures and Monotonicity of Directed Graph Searching. CoRR (2014)
Oriol Vinyals, Lukasz Kaiser, Terry Koo, Slav Petrov, Ilya Sutskever, Geoffrey E. Hinton
Grammar as a Foreign Language. CoRR (2014)
Charles Jordan, Lukasz Kaiser
Experiments with Reduction Finding. SAT (2013)
Lukasz Kaiser, Simon Leßenich
A Counting Logic for Structure Transition Systems. CSL (2012)
Dietmar Berwanger, Erich Grädel, Lukasz Kaiser, Roman Rabinovich
Entanglement and the complexity of directed graphs. Theor. Comput. Sci. 463 (2012)
Lukasz Kaiser
Learning Games from Videos Guided by Descriptive Complexity. AAAI (2012)
Diana Fischer, Lukasz Kaiser
Model Checking the Quantitative mu-Calculus on Linear Hybrid Systems Log. Methods Comput. Sci. 8 (3) (2012)
Michael Holtmann, Lukasz Kaiser, Wolfgang Thomas
Degrees of Lookahead in Regular Infinite Games Log. Methods Comput. Sci. 8 (3) (2012)
Dietmar Berwanger, Lukasz Kaiser, Simon Leßenich
Solving Counter Parity Games. MFCS (2012)
Faried Abu Zaid, Erich Grädel, Lukasz Kaiser
The Field of Reals is not omega-Automatic. STACS (2012)
Dietmar Berwanger, Lukasz Kaiser, Bernd Puchala
A Perfect-Information Construction for Coordination in Games. FSTTCS (2011)
Lukasz Kaiser, Lukasz Stafiniak
First-Order Logic with Counting for General Game Playing. AAAI (2011)
Diana Fischer, Lukasz Kaiser
-Calculus on Linear Hybrid Systems. ICALP (2) (2011)
Vince Bárány, Lukasz Kaiser, Alexander Rabinovich
Expressing cardinality quantifiers in monadic second-order logic over chains. J. Symb. Log. 76 (2) (2011)
Michael Holtmann, Lukasz Kaiser, Wolfgang Thomas
Degrees of Lookahead in Regular Infinite Games. FoSSaCS (2010)
Dietmar Berwanger, Lukasz Kaiser
Information Tracking in Games on Graphs. J. Log. Lang. Inf. 19 (4) (2010)
Diana Fischer, Erich Grädel, Lukasz Kaiser
-Calculus. Theory Comput. Syst. 47 (3) (2010)
Tobias Ganzow, Lukasz Kaiser
New Algorithm for Weak Monadic Second-Order Logic on Inductive Structures. CSL (2010)
Vince Bárány, Lukasz Kaiser, Alexander Moshe Rabinovich
Expressing Cardinality Quantifiers in Monadic Second-Order Logic over Trees. Fundam. Informaticae 100 (1-4) (2010)
Lukasz Kaiser
Synthesis for Structure Rewriting Systems. MFCS (2009)
Vince Bárány, Lukasz Kaiser, Alexander Rabinovich
Cardinality Quantifiers in MLO over Trees. CSL (2009)
Erich Grädel, Lukasz Kaiser, Roman Rabinovich
Directed Graphs of Entanglement Two. FCT (2009)
Lukasz Kaiser, Sasha Rubin, Vince Bárány
Cardinality and counting quantifiers on omega-automatic structures. STACS (2008)
Diana Fischer, Erich Grädel, Lukasz Kaiser
Model Checking Games for the Quantitative mu-Calculus CoRR (2008)
Diana Fischer, Erich Grädel, Lukasz Kaiser
Model Checking Games for the Quantitative µ-Calculus. STACS (2008)
Lukasz Kaiser, Sasha Rubin, Vince Bárány
Cardinality and counting quantifiers on omega-automatic structures CoRR (2008)
Lukasz Kaiser
Game Quantification on Automatic Structures and Hierarchical Model Checking Games. CSL (2006)
Lukasz Kaiser
Confluence of Right Ground Term Rewriting Systems Is Decidable. FoSSaCS (2005)

Lukasz Kaiser.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

Lukasz Kaiser