Valerii Likhosherstov

Publication Activity (10 Years)

Years Active: 2018-2024
Publications (10 Years): 43

Top Topics

Pattern Queries

Language Modeling

Autonomous Driving

Top Venues

Publications

Arijit Sehanobish, Krzysztof Marcin Choromanski, Yunfan Zhao, Kumar Avinava Dubey, Valerii Likhosherstov
Scalable Neural Network Kernels. ICLR (2024)
Reza Mahjourian, Rongbing Mu, Valerii Likhosherstov, Paul Mougin, Xiukun Huang, João V. Messias, Shimon Whiteson
UniGen: Unified Modeling of Initial Agent States and Trajectories for Generating Autonomous Driving Scenarios. ICRA (2024)
Krzysztof Choromanski, Shanda Li, Valerii Likhosherstov, Kumar Avinava Dubey, Shengjie Luo, Di He, Yiming Yang, Tamás Sarlós, Thomas Weingarten, Adrian Weller
Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers. AISTATS (2024)
Reza Mahjourian, Rongbing Mu, Valerii Likhosherstov, Paul Mougin, Xiukun Huang, João V. Messias, Shimon Whiteson
UniGen: Unified Modeling of Initial Agent States and Trajectories for Generating Autonomous Driving Scenarios. CoRR (2024)
Fuzhao Xue, Valerii Likhosherstov, Anurag Arnab, Neil Houlsby, Mostafa Dehghani, Yang You
Adaptive Computation with Elastic Input Sequence. CoRR (2023)
Krzysztof Marcin Choromanski, Arijit Sehanobish, Han Lin, Yunfan Zhao, Eli Berger, Tetiana Parshakova, Alvin Pan, David Watkins, Tianyi Zhang, Valerii Likhosherstov, Somnath Basu Roy Chowdhury, Kumar Avinava Dubey, Deepali Jain, Tamás Sarlós, Snigdha Chaturvedi, Adrian Weller
Efficient Graph Field Integrators Meet Point Clouds. ICML (2023)
Valerii Likhosherstov, Krzysztof Choromanski, Avinava Dubey, Frederick Liu, Tamás Sarlós, Adrian Weller
FAVOR#: Sharp Attention Kernel Approximations via New Classes of Positive Random Features. CoRR (2023)
Arijit Sehanobish, Krzysztof Choromanski, Yunfan Zhao, Avinava Dubey, Valerii Likhosherstov
Scalable Neural Network Kernels. CoRR (2023)
Fuzhao Xue, Valerii Likhosherstov, Anurag Arnab, Neil Houlsby, Mostafa Dehghani, Yang You
Adaptive Computation with Elastic Input Sequence. ICML (2023)
Isaac Reid, Krzysztof Choromanski, Valerii Likhosherstov, Adrian Weller
Simplex Random Features. CoRR (2023)
Isaac Reid, Krzysztof Marcin Choromanski, Valerii Likhosherstov, Adrian Weller
Simplex Random Features. ICML (2023)
Krzysztof Marcin Choromanski, Shanda Li, Valerii Likhosherstov, Kumar Avinava Dubey, Shengjie Luo, Di He, Yiming Yang, Tamás Sarlós, Thomas Weingarten, Adrian Weller
Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers. CoRR (2023)
Valerii Likhosherstov, Anurag Arnab, Krzysztof Marcin Choromanski, Mario Lucic, Yi Tay, Mostafa Dehghani
PolyViT: Co-training Vision Transformers on Images, Videos and Audio. Trans. Mach. Learn. Res. 2023 (2023)
Krzysztof Choromanski, Arijit Sehanobish, Han Lin, Yunfan Zhao, Eli Berger, Tetiana Parshakova, Alvin Pan, David Watkins, Tianyi Zhang, Valerii Likhosherstov, Somnath Basu Roy Chowdhury, Avinava Dubey, Deepali Jain, Tamás Sarlós, Snigdha Chaturvedi, Adrian Weller
Efficient Graph Field Integrators Meet Point Clouds. CoRR (2023)
Valerii Likhosherstov, Krzysztof Marcin Choromanski, Kumar Avinava Dubey, Frederick Liu, Tamás Sarlós, Adrian Weller
Dense-Exponential Random Features: Sharp Positive Estimators of the Gaussian Kernel. NeurIPS (2023)
Valerii Likhosherstov, Krzysztof Choromanski, Adrian Weller
On the Expressive Flexibility of Self-Attention Matrices. AAAI (2023)
Krzysztof Choromanski, Han Lin, Haoxian Chen, Tianyi Zhang, Arijit Sehanobish, Valerii Likhosherstov, Jack Parker-Holder, Tamás Sarlós, Adrian Weller, Thomas Weingarten
From block-Toeplitz matrices to differential equations on graphs: towards a general theory for scalable masked Transformers. ICML (2022)
Valerii Likhosherstov, Krzysztof Choromanski, Avinava Dubey, Frederick Liu, Tamás Sarlós, Adrian Weller
Chefs' Random Tables: Non-Trigonometric Random Features. CoRR (2022)
Zahra Shamsi, Drew Bryant, Jacob Wilson, Xiaoyu Qu, Avinava Dubey, Konik Kothari, Mostafa Dehghani, Mariya Chavarha, Valerii Likhosherstov, Brian Williams, Michael Frumkin, Fred Appelbaum, Krzysztof Choromanski, Ali Bashir, Min Fang
Automated Deep Aberration Detection from Chromosome Karyotype Images. CoRR (2022)
Krzysztof Marcin Choromanski, Han Lin, Haoxian Chen, Arijit Sehanobish, Yuanzhe Ma, Deepali Jain, Jake Varley, Andy Zeng, Michael S. Ryoo, Valerii Likhosherstov, Dmitry Kalashnikov, Vikas Sindhwani, Adrian Weller
Hybrid Random Features. ICLR (2022)
Valerii Likhosherstov, Krzysztof Marcin Choromanski, Kumar Avinava Dubey, Frederick Liu, Tamás Sarlós, Adrian Weller
Chefs' Random Tables: Non-Trigonometric Random Features. NeurIPS (2022)
Valerii Likhosherstov, Xingyou Song, Krzysztof Choromanski, Jared Davis, Adrian Weller
Debiasing a First-order Heuristic for Approximate Bi-level Optimization. CoRR (2021)
Valerii Likhosherstov, Anurag Arnab, Krzysztof Choromanski, Mario Lucic, Yi Tay, Adrian Weller, Mostafa Dehghani
PolyViT: Co-training Vision Transformers on Images, Videos and Audio. CoRR (2021)
Valerii Likhosherstov, Krzysztof Choromanski, Adrian Weller
On the Expressive Power of Self-Attention Matrices. CoRR (2021)
Krzysztof Marcin Choromanski, Valerii Likhosherstov, David Dohan, Xingyou Song, Andreea Gane, Tamás Sarlós, Peter Hawkins, Jared Quincy Davis, Afroz Mohiuddin, Lukasz Kaiser, David Benjamin Belanger, Lucy J. Colwell, Adrian Weller
Rethinking Attention with Performers. ICLR (2021)
Valerii Likhosherstov, Krzysztof Marcin Choromanski, Jared Quincy Davis, Xingyou Song, Adrian Weller
Sub-Linear Memory: How to Make Performers SLiM. NeurIPS (2021)
Krzysztof Choromanski, Deepali Jain, Jack Parker-Holder, Xingyou Song, Valerii Likhosherstov, Anirban Santara, Aldo Pacchiano, Yunhao Tang, Adrian Weller
Unlocking Pixels for Reinforcement Learning via Implicit Attention. CoRR (2021)
Valerii Likhosherstov, Xingyou Song, Krzysztof Choromanski, Jared Quincy Davis, Adrian Weller
Debiasing a First-order Heuristic for Approximate Bi-level Optimization. ICML (2021)
Krzysztof Choromanski, Haoxian Chen, Han Lin, Yuanzhe Ma, Arijit Sehanobish, Deepali Jain, Michael S. Ryoo, Jake Varley, Andy Zeng, Valerii Likhosherstov, Dmitry Kalashnikov, Vikas Sindhwani, Adrian Weller
Hybrid Random Features. CoRR (2021)
Valerii Likhosherstov, Jared Davis, Krzysztof Choromanski, Adrian Weller
CWY Parametrization: a Solution for Parallelized Optimization of Orthogonal and Stiefel Matrices. AISTATS (2021)
Valerii Likhosherstov, Jared Davis, Krzysztof Choromanski, Adrian Weller
CWY Parametrization for Scalable Learning of Orthogonal and Stiefel Matrices. CoRR (2020)
Valerii Likhosherstov, Krzysztof Choromanski, Jared Davis, Xingyou Song, Adrian Weller
Sub-Linear Memory: How to Make Performers SLiM. CoRR (2020)
Valerii Likhosherstov, Xingyou Song, Krzysztof Choromanski, Jared Davis, Adrian Weller
UFO-BLO: Unbiased First-Order Bilevel Optimization. CoRR (2020)
Krzysztof Choromanski, David Cheikhi, Jared Davis, Valerii Likhosherstov, Achille Nazaret, Achraf Bahamou, Xingyou Song, Mrugank Akarte, Jack Parker-Holder, Jacob Bergquist, Yuan Gao, Aldo Pacchiano, Tamás Sarlós, Adrian Weller, Vikas Sindhwani
Stochastic Flows and Geometric Optimization on the Orthogonal Group. ICML (2020)
Krzysztof Marcin Choromanski, Jared Quincy Davis, Valerii Likhosherstov, Xingyou Song, Jean-Jacques E. Slotine, Jacob Varley, Honglak Lee, Adrian Weller, Vikas Sindhwani
Ode to an ODE. NeurIPS (2020)
Krzysztof Choromanski, David Cheikhi, Jared Davis, Valerii Likhosherstov, Achille Nazaret, Achraf Bahamou, Xingyou Song, Mrugank Akarte, Jack Parker-Holder, Jacob Bergquist, Yuan Gao, Aldo Pacchiano, Tamás Sarlós, Adrian Weller, Vikas Sindhwani
Stochastic Flows and Geometric Optimization on the Orthogonal Group. CoRR (2020)
Krzysztof Choromanski, Jared Quincy Davis, Valerii Likhosherstov, Xingyou Song, Jean-Jacques E. Slotine, Jacob Varley, Honglak Lee, Adrian Weller, Vikas Sindhwani
An Ode to an ODE. CoRR (2020)
Krzysztof Choromanski, Valerii Likhosherstov, David Dohan, Xingyou Song, Jared Davis, Tamás Sarlós, David Belanger, Lucy J. Colwell, Adrian Weller
Masked Language Modeling for Proteins via Linearly Scalable Long-Context Transformers. CoRR (2020)
Krzysztof Choromanski, Valerii Likhosherstov, David Dohan, Xingyou Song, Andreea Gane, Tamás Sarlós, Peter Hawkins, Jared Davis, Afroz Mohiuddin, Lukasz Kaiser, David Belanger, Lucy J. Colwell, Adrian Weller
Rethinking Attention with Performers. CoRR (2020)
Valerii Likhosherstov, Yury Maximov, Misha Chertkov
Inference and Sampling of $K_33$-free Ising Models. ICML (2019)
Valerii Likhosherstov, Yury Maximov, Michael Chertkov
A New Family of Tractable Ising Models. CoRR (2019)
Valerii Likhosherstov, Yury Maximov, Michael Chertkov
Tractable Minor-free Generalization of Planar Zero-field Ising Models. CoRR (2019)
Valerii Likhosherstov, Yury Maximov, Michael Chertkov
-free Ising Models. CoRR (2018)