Albert Gu

88 papers A* 32Misc 1Journal 51Unranked 4
YearRankTypeTitle / Venue / Authors
2026 J jnl
Mamba-3: Improved Sequence Modeling using State Space Principles.
CoRR
Aakash Lahoti, Kevin Y. Li, Berlin Chen, Caitlin Wang, Aviv Bick, J. Zico Kolter, Tri Dao, Albert Gu
2026 J jnl
Retrieval-Aware Distillation for Transformer-SSM Hybrids.
CoRR
Aviv Bick, Eric P. Xing, Albert Gu
2026 J jnl
dnaHNet: A Scalable and Hierarchical Foundation Model for Genomic Sequence Learning.
CoRR
Arnav Shah, Junzhe Li, Parsa Idehpour, Adibvafa Fallahpour, Brandon Wang, Sukjun Hwang, Bo Wang, Patrick D. Hsu, Hani Goodarzi, Albert Gu
2025 J jnl
ARC-AGI Without Pretraining.
CoRR
Isaac Liao, Albert Gu
2025 J jnl
Autoregressive Universal Video Segmentation Model.
CoRR
Miran Heo, Sukjun Hwang, Min-Hung Chen, Yu-Chiang Frank Wang, Albert Gu, Seon Joo Kim, Ryo Hachiuma
2025 J jnl
Chimera: State Space Models Beyond Sequences.
CoRR
Aakash Lahoti, Tanya Marwah, Ratish Puduppully, Albert Gu
2025 J jnl
Chimera: State Space Models Beyond Sequences.
Trans. Mach. Learn. Res.
Aakash Lahoti, Tanya Marwah, Ratish Puduppully, Albert Gu
2025 J jnl
Dynamic Chunking for End-to-End Hierarchical Sequence Modeling.
CoRR
Sukjun Hwang, Brandon Wang, Albert Gu
2025 J jnl
HybriDNA: A Hybrid Transformer-Mamba2 Long-Range DNA Language Model.
CoRR
Mingqian Ma, Guoqing Liu, Chuan Cao, Pan Deng, Tri Dao, Albert Gu, Peiran Jin, Zhao Yang, Yingce Xia, Renqian Luo, Pipi Hu, Zun Wang, Yuan-Jyue Chen, Haiguang Liu, Tao Qin
2025 J jnl
Joint Distillation for Fast Likelihood Evaluation and Sampling in Flow-based Models.
CoRR
Xinyue Ai, Yutong He, Albert Gu, Ruslan Salakhutdinov, J. Zico Kolter, Nicholas Matthew Boffi, Max Simchowitz
2025 J jnl
Llamba: Scaling Distilled Recurrent Models for Efficient Language Processing.
CoRR
Aviv Bick, Tobias Katsch, Nimit Sharad Sohoni, Arjun Desai, Albert Gu
2025 J jnl
Lyra: An Efficient and Expressive Subquadratic Architecture for Modeling Biological Sequences.
CoRR
Krithik Ramesh, Sameed M. Siddiqui, Albert Gu, Michael Mitzenmacher, Pardis C. Sabeti
2025 A* conf
On the Benefits of Memory for Modeling Time-Dependent PDEs.
ICLR
Ricardo Buitrago Ruiz, Tanya Marwah, Albert Gu, Andrej Risteski
2025 J jnl
Thinking Slow, Fast: Scaling Inference Compute with Distilled Reasoners.
CoRR
Daniele Paliotta, Junxiong Wang, Matteo Pagliardini, Kevin Y. Li, Aviv Bick, J. Zico Kolter, Albert Gu, François Fleuret, Tri Dao
2025 — conf
Towards Codec-LM Co-design for Neural Codec Language Models.
NAACL (Student Research Workshop)
Shih-Lun Wu, Aakash Lahoti, Arjun Desai, Karan Goel, Chris Donahue, Albert Gu
2025 A* conf
Understanding and Improving Length Generalization in Recurrent Models.
ICML
Ricardo Buitrago Ruiz, Albert Gu
2025 J jnl
Understanding and Improving Length Generalization in Recurrent Models.
CoRR
Ricardo Buitrago Ruiz, Albert Gu
2025 A* conf
Understanding the Skill Gap in Recurrent Language Models: The Role of the Gather-and-Aggregate Mechanism.
ICML
Aviv Bick, Eric P. Xing, Albert Gu
2025 J jnl
Understanding the Skill Gap in Recurrent Language Models: The Role of the Gather-and-Aggregate Mechanism.
CoRR
Aviv Bick, Eric P. Xing, Albert Gu
2024 J jnl
An Empirical Study of Mamba-based Language Models.
CoRR
Roger Waleffe, Wonmin Byeon, Duncan Riach, Brandon Norick, Vijay Korthikanti, Tri Dao, Albert Gu, Ali Hatamizadeh, Sudhakar Singh, Deepak Narayanan, Garvit Kulshreshtha, Vartika Singh, Jared Casper, Jan Kautz, Mohammad Shoeybi, Bryan Catanzaro
2024 Misc conf
Augmenting Conformers With Structured State-Space Sequence Models For Online Speech Recognition.
ICASSP
Haozhe Shan, Albert Gu, Zhong Meng, Weiran Wang, Krzysztof Choromanski, Tara N. Sainath
2024 A* conf
Caduceus: Bi-Directional Equivariant Long-Range DNA Sequence Modeling.
ICML
Yair Schiff, Chia-Hsiang Kao, Aaron Gokaslan, Tri Dao, Albert Gu, Volodymyr Kuleshov
2024 J jnl
Caduceus: Bi-Directional Equivariant Long-Range DNA Sequence Modeling.
CoRR
Yair Schiff, Chia-Hsiang Kao, Aaron Gokaslan, Tri Dao, Albert Gu, Volodymyr Kuleshov
2024 J jnl
Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models.
CoRR
Soham De, Samuel L. Smith, Anushan Fernando, Aleksandar Botev, George-Cristian Muraru, Albert Gu, Ruba Haroun, Leonard Berrada, Yutian Chen, Srivatsan Srinivasan, Guillaume Desjardins, Arnaud Doucet, David Budden, Yee Whye Teh, Razvan Pascanu, Nando de Freitas, Caglar Gulcehre
2024 A* conf
Hydra: Bidirectional State Space Models Through Generalized Matrix Mixers.
NeurIPS
Sukjun Hwang, Aakash Sunil Lahoti, Ratish Puduppully, Tri Dao, Albert Gu
2024 J jnl
Hydra: Bidirectional State Space Models Through Generalized Matrix Mixers.
CoRR
Sukjun Hwang, Aakash Lahoti, Tri Dao, Albert Gu
2024 J jnl
On the Benefits of Memory for Modeling Time-Dependent PDEs.
CoRR
Ricardo Buitrago Ruiz, Tanya Marwah, Albert Gu, Andrej Risteski
2024 A* conf
Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality.
ICML
Tri Dao, Albert Gu
2024 J jnl
Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality.
CoRR
Tri Dao, Albert Gu
2024 A* conf
Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Models.
NeurIPS
Aviv Bick, Kevin Y. Li, Eric P. Xing, J. Zico Kolter, Albert Gu
2024 J jnl
Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Models.
CoRR
Aviv Bick, Kevin Y. Li, Eric P. Xing, J. Zico Kolter, Albert Gu
2023 J jnl
Augmenting conformers with structured state space models for online speech recognition.
CoRR
Haozhe Shan, Albert Gu, Zhong Meng, Weiran Wang, Krzysztof Choromanski, Tara N. Sainath
2023 A* conf
How to Train your HIPPO: State Space Models with Generalized Orthogonal Basis Projections.
ICLR
Albert Gu, Isys Johnson, Aman Timalsina, Atri Rudra, Christopher Ré
2023 J jnl
Mamba: Linear-Time Sequence Modeling with Selective State Spaces.
CoRR
Albert Gu, Tri Dao
2023 A* conf
Modelling Long Range Dependencies in $N$D: From Task-Specific to a General Purpose CNN.
ICLR
David M. Knigge, David W. Romero, Albert Gu, Efstratios Gavves, Erik J. Bekkers, Jakub Mikolaj Tomczak, Mark Hoogendoorn, Jan-Jakob Sonke
2023 J jnl
Modelling Long Range Dependencies in N-D: From Task-Specific to a General Purpose CNN.
CoRR
David M. Knigge, David W. Romero, Albert Gu, Efstratios Gavves, Erik J. Bekkers, Jakub M. Tomczak, Mark Hoogendoorn, Jan-Jakob Sonke
2023 — conf
Pretraining Without Attention.
EMNLP (Findings)
Junxiong Wang, Jing Nathan Yan, Albert Gu, Alexander M. Rush
2023 A* conf
Resurrecting Recurrent Neural Networks for Long Sequences.
ICML
Antonio Orvieto, Samuel L. Smith, Albert Gu, Anushan Fernando, Çaglar Gülçehre, Razvan Pascanu, Soham De
2023 J jnl
Resurrecting Recurrent Neural Networks for Long Sequences.
CoRR
Antonio Orvieto, Samuel L. Smith, Albert Gu, Anushan Fernando, Çaglar Gülçehre, Razvan Pascanu, Soham De
2023 A* conf
Structured State Space Models for In-Context Reinforcement Learning.
NeurIPS
Chris Lu, Yannick Schroecker, Albert Gu, Emilio Parisotto, Jakob N. Foerster, Satinder Singh, Feryal M. P. Behbahani
2023 J jnl
Structured State Space Models for In-Context Reinforcement Learning.
CoRR
Chris Lu, Yannick Schroecker, Albert Gu, Emilio Parisotto, Jakob N. Foerster, Satinder Singh, Feryal M. P. Behbahani
2022 A* conf
Diagonal State Spaces are as Effective as Structured State Spaces.
NeurIPS
Ankit Gupta, Albert Gu, Jonathan Berant
2022 A* conf
Efficiently Modeling Long Sequences with Structured State Spaces.
ICLR
Albert Gu, Karan Goel, Christopher Ré
2022 J jnl
How to Train Your HiPPO: State Space Models with Generalized Orthogonal Basis Projections.
CoRR
Albert Gu, Isys Johnson, Aman Timalsina, Atri Rudra, Christopher Ré
2022 A* conf
It's Raw! Audio Generation with State-Space Models.
ICML
Karan Goel, Albert Gu, Chris Donahue, Christopher Ré
2022 J jnl
It's Raw! Audio Generation with State-Space Models.
CoRR
Karan Goel, Albert Gu, Chris Donahue, Christopher Ré
2022 A* conf
On the Parameterization and Initialization of Diagonal State Space Models.
NeurIPS
Albert Gu, Karan Goel, Ankit Gupta, Christopher Ré
2022 J jnl
On the Parameterization and Initialization of Diagonal State Space Models.
CoRR
Albert Gu, Ankit Gupta, Karan Goel, Christopher Ré
2022 J jnl
Pretraining Without Attention.
CoRR
Junxiong Wang, Jing Nathan Yan, Albert Gu, Alexander M. Rush
2022 J jnl
S4ND: Modeling Images and Videos as Multidimensional Signals Using State Spaces.
CoRR
Eric Nguyen, Karan Goel, Albert Gu, Gordon W. Downs, Preey Shah, Tri Dao, Stephen A. Baccus, Christopher Ré
2022 A* conf
S4ND: Modeling Images and Videos as Multidimensional Signals with State Spaces.
NeurIPS
Eric Nguyen, Karan Goel, Albert Gu, Gordon W. Downs, Preey Shah, Tri Dao, Stephen Baccus, Christopher Ré
2022 J jnl
Towards a General Purpose CNN for Long Range Dependencies in ND.
CoRR
David W. Romero, David M. Knigge, Albert Gu, Erik J. Bekkers, Efstratios Gavves, Jakub M. Tomczak, Mark Hoogendoorn
2021 A* conf
Catformer: Designing Stable Transformers via Sensitivity Analysis.
ICML
Jared Quincy Davis, Albert Gu, Krzysztof Choromanski, Tri Dao, Christopher Ré, Chelsea Finn, Percy Liang
2021 A* conf
Combining Recurrent, Convolutional, and Continuous-time Models with Linear State Space Layers.
NeurIPS
Albert Gu, Isys Johnson, Karan Goel, Khaled Saab, Tri Dao, Atri Rudra, Christopher Ré
2021 J jnl
Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layers.
CoRR
Albert Gu, Isys Johnson, Karan Goel, Khaled Saab, Tri Dao, Atri Rudra, Christopher Ré
2021 J jnl
Efficiently Modeling Long Sequences with Structured State Spaces.
CoRR
Albert Gu, Karan Goel, Christopher Ré
2021 A* conf
HoroPCA: Hyperbolic Dimensionality Reduction via Horospherical Projections.
ICML
Ines Chami, Albert Gu, Dat Nguyen, Christopher Ré
2021 J jnl
HoroPCA: Hyperbolic Dimensionality Reduction via Horospherical Projections.
CoRR
Ines Chami, Albert Gu, Dat Nguyen, Christopher Ré
2021 A* conf
Model Patching: Closing the Subgroup Performance Gap with Data Augmentation.
ICLR
Karan Goel, Albert Gu, Sharon Li, Christopher Ré
2020 A* conf
From Trees to Continuous Embeddings and Back: Hyperbolic Hierarchical Clustering.
NeurIPS
Ines Chami, Albert Gu, Vaggos Chatziafratis, Christopher Ré
2020 J jnl
From Trees to Continuous Embeddings and Back: Hyperbolic Hierarchical Clustering.
CoRR
Ines Chami, Albert Gu, Vaggos Chatziafratis, Christopher Ré
2020 A* conf
HiPPO: Recurrent Memory with Optimal Polynomial Projections.
NeurIPS
Albert Gu, Tri Dao, Stefano Ermon, Atri Rudra, Christopher Ré
2020 J jnl
HiPPO: Recurrent Memory with Optimal Polynomial Projections.
CoRR
Albert Gu, Tri Dao, Stefano Ermon, Atri Rudra, Christopher Ré
2020 A* conf
Improving the Gating Mechanism of Recurrent Neural Networks.
ICML
Albert Gu, Çaglar Gülçehre, Thomas Paine, Matt Hoffman, Razvan Pascanu
2020 A* conf
Kaleidoscope: An Efficient, Learnable Representation For All Structured Linear Maps.
ICLR
Tri Dao, Nimit Sharad Sohoni, Albert Gu, Matthew Eichhorn, Amit Blonder, Megan Leszczynski, Atri Rudra, Christopher Ré
2020 J jnl
Kaleidoscope: An Efficient, Learnable Representation For All Structured Linear Maps.
CoRR
Tri Dao, Nimit Sharad Sohoni, Albert Gu, Matthew Eichhorn, Amit Blonder, Megan Leszczynski, Atri Rudra, Christopher Ré
2020 J jnl
Model Patching: Closing the Subgroup Performance Gap with Data Augmentation.
CoRR
Karan Goel, Albert Gu, Sharon Li, Christopher Ré
2020 A* conf
No Subclass Left Behind: Fine-Grained Robustness in Coarse-Grained Classification Problems.
NeurIPS
Nimit Sharad Sohoni, Jared Dunnmon, Geoffrey Angus, Albert Gu, Christopher Ré
2020 J jnl
No Subclass Left Behind: Fine-Grained Robustness in Coarse-Grained Classification Problems.
CoRR
Nimit Sharad Sohoni, Jared A. Dunnmon, Geoffrey Angus, Albert Gu, Christopher Ré
2020 A* conf
Sparse Recovery for Orthogonal Polynomial Transforms.
ICALP
Anna C. Gilbert, Albert Gu, Christopher Ré, Atri Rudra, Mary Wootters
2019 A* conf
A Kernel Theory of Modern Data Augmentation.
ICML
Tri Dao, Albert Gu, Alexander Ratner, Virginia Smith, Chris De Sa, Christopher Ré
2019 J jnl
Improving the Gating Mechanism of Recurrent Neural Networks.
CoRR
Albert Gu, Çaglar Gülçehre, Tom Le Paine, Matthew W. Hoffman, Razvan Pascanu
2019 A* conf
Learning Fast Algorithms for Linear Transforms Using Butterfly Factorizations.
ICML
Tri Dao, Albert Gu, Matthew Eichhorn, Atri Rudra, Christopher Ré
2019 J jnl
Learning Fast Algorithms for Linear Transforms Using Butterfly Factorizations.
CoRR
Tri Dao, Albert Gu, Matthew Eichhorn, Atri Rudra, Christopher Ré
2019 — conf
Learning Mixed-Curvature Representations in Product Spaces.
ICLR (Poster)
Albert Gu, Frederic Sala, Beliz Gunel, Christopher Ré
2019 J jnl
Sparse Recovery for Orthogonal Polynomial Transforms.
CoRR
Anna C. Gilbert, Albert Gu, Christopher Ré, Atri Rudra, Mary Wootters
2018 J jnl
A Kernel Theory of Modern Data Augmentation.
CoRR
Tri Dao, Albert Gu, Alexander J. Ratner, Virginia Smith, Christopher De Sa, Christopher Ré
2018 A* conf
A Two-pronged Progress in Structured Dense Matrix Vector Multiplication.
SODA
Christopher De Sa, Albert Gu, Rohan Puttagunta, Christopher Ré, Atri Rudra
2018 A* conf
Learning Compressed Transforms with Low Displacement Rank.
NeurIPS
Anna T. Thomas, Albert Gu, Tri Dao, Atri Rudra, Christopher Ré
2018 J jnl
Learning Compressed Transforms with Low Displacement Rank.
CoRR
Anna T. Thomas, Albert Gu, Tri Dao, Atri Rudra, Christopher Ré
2018 — conf
Learning Invariance with Compact Transforms.
ICLR (Workshop)
Anna T. Thomas, Albert Gu, Tri Dao, Atri Rudra, Christopher Ré
2018 A* conf
Representation Tradeoffs for Hyperbolic Embeddings.
ICML
Frederic Sala, Christopher De Sa, Albert Gu, Christopher Ré
2018 J jnl
Representation Tradeoffs for Hyperbolic Embeddings.
CoRR
Christopher De Sa, Albert Gu, Christopher Ré, Frederic Sala
2016 J jnl
Recurrence Width for Structured Dense Matrix Vector Multiplication.
CoRR
Albert Gu, Rohan Puttagunta, Christopher Ré, Atri Rudra
2016 J jnl
The Power of Deferral: Maintaining a Constant-Competitive Steiner Tree Online.
SIAM J. Comput.
Albert Gu, Anupam Gupta, Amit Kumar
2015 J jnl
Sprague-Grundy Values of the $\mathcal{R}$-Wythoff Game.
Electron. J. Comb.
Albert Gu
2013 J jnl
The Power of Deferral: Maintaining a Constant-Competitive Steiner Tree Online.
CoRR
Albert Gu, Anupam Gupta, Amit Kumar
2013 A* conf
The power of deferral: maintaining a constant-competitive steiner tree online.
STOC
Albert Gu, Anupam Gupta, Amit Kumar