Valerii Likhosherstov

43 papers A* 16A 2Journal 25

Year	Rank	Type	Title / Venue / Authors
2024	A	`conf`	Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers. AISTATS Krzysztof Choromanski, Shanda Li, Valerii Likhosherstov, Kumar Avinava Dubey, Shengjie Luo, Di He, Yiming Yang, Tamás Sarlós, Thomas Weingarten, Adrian Weller
2024	A*	`conf`	Scalable Neural Network Kernels. ICLR Arijit Sehanobish, Krzysztof Marcin Choromanski, Yunfan Zhao, Kumar Avinava Dubey, Valerii Likhosherstov
2024	A*	`conf`	UniGen: Unified Modeling of Initial Agent States and Trajectories for Generating Autonomous Driving Scenarios. ICRA Reza Mahjourian, Rongbing Mu, Valerii Likhosherstov, Paul Mougin, Xiukun Huang, João V. Messias, Shimon Whiteson
2024	J	`jnl`	UniGen: Unified Modeling of Initial Agent States and Trajectories for Generating Autonomous Driving Scenarios. CoRR Reza Mahjourian, Rongbing Mu, Valerii Likhosherstov, Paul Mougin, Xiukun Huang, João V. Messias, Shimon Whiteson
2023	A*	`conf`	Adaptive Computation with Elastic Input Sequence. ICML Fuzhao Xue, Valerii Likhosherstov, Anurag Arnab, Neil Houlsby, Mostafa Dehghani, Yang You
2023	J	`jnl`	Adaptive Computation with Elastic Input Sequence. CoRR Fuzhao Xue, Valerii Likhosherstov, Anurag Arnab, Neil Houlsby, Mostafa Dehghani, Yang You
2023	A*	`conf`	Dense-Exponential Random Features: Sharp Positive Estimators of the Gaussian Kernel. NeurIPS Valerii Likhosherstov, Krzysztof Marcin Choromanski, Kumar Avinava Dubey, Frederick Liu, Tamás Sarlós, Adrian Weller
2023	A*	`conf`	Efficient Graph Field Integrators Meet Point Clouds. ICML Krzysztof Marcin Choromanski, Arijit Sehanobish, Han Lin, Yunfan Zhao, Eli Berger, Tetiana Parshakova, Alvin Pan, David Watkins, Tianyi Zhang, Valerii Likhosherstov, Somnath Basu Roy Chowdhury, Kumar Avinava Dubey, Deepali Jain, Tamás Sarlós, Snigdha Chaturvedi, Adrian Weller
2023	J	`jnl`	Efficient Graph Field Integrators Meet Point Clouds. CoRR Krzysztof Choromanski, Arijit Sehanobish, Han Lin, Yunfan Zhao, Eli Berger, Tetiana Parshakova, Alvin Pan, David Watkins, Tianyi Zhang, Valerii Likhosherstov, Somnath Basu Roy Chowdhury, Avinava Dubey, Deepali Jain, Tamás Sarlós, Snigdha Chaturvedi, Adrian Weller
2023	J	`jnl`	FAVOR#: Sharp Attention Kernel Approximations via New Classes of Positive Random Features. CoRR Valerii Likhosherstov, Krzysztof Choromanski, Avinava Dubey, Frederick Liu, Tamás Sarlós, Adrian Weller
2023	J	`jnl`	Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers. CoRR Krzysztof Marcin Choromanski, Shanda Li, Valerii Likhosherstov, Kumar Avinava Dubey, Shengjie Luo, Di He, Yiming Yang, Tamás Sarlós, Thomas Weingarten, Adrian Weller
2023	A*	`conf`	On the Expressive Flexibility of Self-Attention Matrices. AAAI Valerii Likhosherstov, Krzysztof Choromanski, Adrian Weller
2023	J	`jnl`	PolyViT: Co-training Vision Transformers on Images, Videos and Audio. Trans. Mach. Learn. Res. Valerii Likhosherstov, Anurag Arnab, Krzysztof Marcin Choromanski, Mario Lucic, Yi Tay, Mostafa Dehghani
2023	J	`jnl`	Scalable Neural Network Kernels. CoRR Arijit Sehanobish, Krzysztof Choromanski, Yunfan Zhao, Avinava Dubey, Valerii Likhosherstov
2023	A*	`conf`	Simplex Random Features. ICML Isaac Reid, Krzysztof Marcin Choromanski, Valerii Likhosherstov, Adrian Weller
2023	J	`jnl`	Simplex Random Features. CoRR Isaac Reid, Krzysztof Choromanski, Valerii Likhosherstov, Adrian Weller
2022	J	`jnl`	Automated Deep Aberration Detection from Chromosome Karyotype Images. CoRR Zahra Shamsi, Drew Bryant, Jacob Wilson, Xiaoyu Qu, Avinava Dubey, Konik Kothari, Mostafa Dehghani, Mariya Chavarha, Valerii Likhosherstov, Brian Williams, Michael Frumkin, Fred Appelbaum, Krzysztof Choromanski, Ali Bashir, Min Fang
2022	A*	`conf`	Chefs' Random Tables: Non-Trigonometric Random Features. NeurIPS Valerii Likhosherstov, Krzysztof Marcin Choromanski, Kumar Avinava Dubey, Frederick Liu, Tamás Sarlós, Adrian Weller
2022	J	`jnl`	Chefs' Random Tables: Non-Trigonometric Random Features. CoRR Valerii Likhosherstov, Krzysztof Choromanski, Avinava Dubey, Frederick Liu, Tamás Sarlós, Adrian Weller
2022	A*	`conf`	From block-Toeplitz matrices to differential equations on graphs: towards a general theory for scalable masked Transformers. ICML Krzysztof Choromanski, Han Lin, Haoxian Chen, Tianyi Zhang, Arijit Sehanobish, Valerii Likhosherstov, Jack Parker-Holder, Tamás Sarlós, Adrian Weller, Thomas Weingarten
2022	A*	`conf`	Hybrid Random Features. ICLR Krzysztof Marcin Choromanski, Han Lin, Haoxian Chen, Arijit Sehanobish, Yuanzhe Ma, Deepali Jain, Jake Varley, Andy Zeng, Michael S. Ryoo, Valerii Likhosherstov, Dmitry Kalashnikov, Vikas Sindhwani, Adrian Weller
2021	A	`conf`	CWY Parametrization: a Solution for Parallelized Optimization of Orthogonal and Stiefel Matrices. AISTATS Valerii Likhosherstov, Jared Davis, Krzysztof Choromanski, Adrian Weller
2021	A*	`conf`	Debiasing a First-order Heuristic for Approximate Bi-level Optimization. ICML Valerii Likhosherstov, Xingyou Song, Krzysztof Choromanski, Jared Quincy Davis, Adrian Weller
2021	J	`jnl`	Debiasing a First-order Heuristic for Approximate Bi-level Optimization. CoRR Valerii Likhosherstov, Xingyou Song, Krzysztof Choromanski, Jared Davis, Adrian Weller
2021	J	`jnl`	Hybrid Random Features. CoRR Krzysztof Choromanski, Haoxian Chen, Han Lin, Yuanzhe Ma, Arijit Sehanobish, Deepali Jain, Michael S. Ryoo, Jake Varley, Andy Zeng, Valerii Likhosherstov, Dmitry Kalashnikov, Vikas Sindhwani, Adrian Weller
2021	J	`jnl`	On the Expressive Power of Self-Attention Matrices. CoRR Valerii Likhosherstov, Krzysztof Choromanski, Adrian Weller
2021	J	`jnl`	PolyViT: Co-training Vision Transformers on Images, Videos and Audio. CoRR Valerii Likhosherstov, Anurag Arnab, Krzysztof Choromanski, Mario Lucic, Yi Tay, Adrian Weller, Mostafa Dehghani
2021	A*	`conf`	Rethinking Attention with Performers. ICLR Krzysztof Marcin Choromanski, Valerii Likhosherstov, David Dohan, Xingyou Song, Andreea Gane, Tamás Sarlós, Peter Hawkins, Jared Quincy Davis, Afroz Mohiuddin, Lukasz Kaiser, David Benjamin Belanger, Lucy J. Colwell, Adrian Weller
2021	A*	`conf`	Sub-Linear Memory: How to Make Performers SLiM. NeurIPS Valerii Likhosherstov, Krzysztof Marcin Choromanski, Jared Quincy Davis, Xingyou Song, Adrian Weller
2021	J	`jnl`	Unlocking Pixels for Reinforcement Learning via Implicit Attention. CoRR Krzysztof Choromanski, Deepali Jain, Jack Parker-Holder, Xingyou Song, Valerii Likhosherstov, Anirban Santara, Aldo Pacchiano, Yunhao Tang, Adrian Weller
2020	J	`jnl`	An Ode to an ODE. CoRR Krzysztof Choromanski, Jared Quincy Davis, Valerii Likhosherstov, Xingyou Song, Jean-Jacques E. Slotine, Jacob Varley, Honglak Lee, Adrian Weller, Vikas Sindhwani
2020	J	`jnl`	CWY Parametrization for Scalable Learning of Orthogonal and Stiefel Matrices. CoRR Valerii Likhosherstov, Jared Davis, Krzysztof Choromanski, Adrian Weller
2020	J	`jnl`	Masked Language Modeling for Proteins via Linearly Scalable Long-Context Transformers. CoRR Krzysztof Choromanski, Valerii Likhosherstov, David Dohan, Xingyou Song, Jared Davis, Tamás Sarlós, David Belanger, Lucy J. Colwell, Adrian Weller
2020	A*	`conf`	Ode to an ODE. NeurIPS Krzysztof Marcin Choromanski, Jared Quincy Davis, Valerii Likhosherstov, Xingyou Song, Jean-Jacques E. Slotine, Jacob Varley, Honglak Lee, Adrian Weller, Vikas Sindhwani
2020	J	`jnl`	Rethinking Attention with Performers. CoRR Krzysztof Choromanski, Valerii Likhosherstov, David Dohan, Xingyou Song, Andreea Gane, Tamás Sarlós, Peter Hawkins, Jared Davis, Afroz Mohiuddin, Lukasz Kaiser, David Belanger, Lucy J. Colwell, Adrian Weller
2020	A*	`conf`	Stochastic Flows and Geometric Optimization on the Orthogonal Group. ICML Krzysztof Choromanski, David Cheikhi, Jared Davis, Valerii Likhosherstov, Achille Nazaret, Achraf Bahamou, Xingyou Song, Mrugank Akarte, Jack Parker-Holder, Jacob Bergquist, Yuan Gao, Aldo Pacchiano, Tamás Sarlós, Adrian Weller, Vikas Sindhwani
2020	J	`jnl`	Stochastic Flows and Geometric Optimization on the Orthogonal Group. CoRR Krzysztof Choromanski, David Cheikhi, Jared Davis, Valerii Likhosherstov, Achille Nazaret, Achraf Bahamou, Xingyou Song, Mrugank Akarte, Jack Parker-Holder, Jacob Bergquist, Yuan Gao, Aldo Pacchiano, Tamás Sarlós, Adrian Weller, Vikas Sindhwani
2020	J	`jnl`	Sub-Linear Memory: How to Make Performers SLiM. CoRR Valerii Likhosherstov, Krzysztof Choromanski, Jared Davis, Xingyou Song, Adrian Weller
2020	J	`jnl`	UFO-BLO: Unbiased First-Order Bilevel Optimization. CoRR Valerii Likhosherstov, Xingyou Song, Krzysztof Choromanski, Jared Davis, Adrian Weller
2019	J	`jnl`	A New Family of Tractable Ising Models. CoRR Valerii Likhosherstov, Yury Maximov, Michael Chertkov
2019	A*	`conf`	Inference and Sampling of $K_33$-free Ising Models. ICML Valerii Likhosherstov, Yury Maximov, Misha Chertkov
2019	J	`jnl`	Tractable Minor-free Generalization of Planar Zero-field Ising Models. CoRR Valerii Likhosherstov, Yury Maximov, Michael Chertkov
2018	J	`jnl`	Inference and Sampling of K CoRR Valerii Likhosherstov, Yury Maximov, Michael Chertkov