Marco Bondaschi

26 papers A* 5B 5Journal 16
YearRankTypeTitle / Venue / Authors
2025 J jnl
Alpha-NML Universal Predictors.
IEEE Trans. Inf. Theory
Marco Bondaschi, Michael Gastpar
2025 A* conf
Attention with Markov: A Curious Case of Single-layer Transformers.
ICLR
Ashok Vardhan Makkuva, Marco Bondaschi, Adway Girish, Alliot Nagle, Martin Jaggi, Hyeji Kim, Michael Gastpar
2025 J jnl
From Markov to Laplace: How Mamba In-Context Learns Markov Chains.
CoRR
Marco Bondaschi, Nived Rajaraman, Xiuying Wei, Kannan Ramchandran, Razvan Pascanu, Caglar Gulcehre, Michael Gastpar, Ashok Vardhan Makkuva
2025 B conf
The Conditional Regret-Capacity Theorem for Batch Universal Prediction.
ITW
Marco Bondaschi, Michael Gastpar
2025 J jnl
The Conditional Regret-Capacity Theorem for Batch Universal Prediction.
CoRR
Marco Bondaschi, Michael Gastpar
2025 J jnl
What One Cannot, Two Can: Two-Layer Transformers Provably Represent Induction Heads on Any-Order Markov Chains.
CoRR
Chanakya Ekbote, Marco Bondaschi, Nived Rajaraman, Jason D. Lee, Michael Gastpar, Ashok Vardhan Makkuva, Paul Pu Liang
2024 J jnl
Attention with Markov: A Framework for Principled Analysis of Transformers via Markov Chains.
CoRR
Ashok Vardhan Makkuva, Marco Bondaschi, Adway Girish, Alliot Nagle, Martin Jaggi, Hyeji Kim, Michael Gastpar
2024 J jnl
Batch Normalization Decomposed.
CoRR
Ido Nachum, Marco Bondaschi, Michael Gastpar, Anatoly Khina
2024 B conf
Batch Universal Prediction.
ISIT
Marco Bondaschi, Michael Gastpar
2024 J jnl
Batch Universal Prediction.
CoRR
Marco Bondaschi, Michael Gastpar
2024 A* conf
Fundamental Limits of Prompt Compression: A Rate-Distortion Framework for Black-Box Language Models.
NeurIPS
Alliot Nagle, Adway Girish, Marco Bondaschi, Michael Gastpar, Ashok Vardhan Makkuva, Hyeji Kim
2024 J jnl
Fundamental Limits of Prompt Compression: A Rate-Distortion Framework for Black-Box Language Models.
CoRR
Adway Girish, Alliot Nagle, Marco Bondaschi, Michael Gastpar, Ashok Vardhan Makkuva, Hyeji Kim
2024 A* conf
LASER: Linear Compression in Wireless Distributed Optimization.
ICML
Ashok Vardhan Makkuva, Marco Bondaschi, Thijs Vogels, Martin Jaggi, Hyeji Kim, Michael Gastpar
2024 A* conf
Local to Global: Learning Dynamics and Effect of Initialization for Transformers.
NeurIPS
Ashok Vardhan Makkuva, Marco Bondaschi, Adway Girish, Alliot Nagle, Hyeji Kim, Michael Gastpar, Chanakya Ekbote
2024 J jnl
Local to Global: Learning Dynamics and Effect of Initialization for Transformers.
CoRR
Ashok Vardhan Makkuva, Marco Bondaschi, Chanakya Ekbote, Adway Girish, Alliot Nagle, Hyeji Kim, Michael Gastpar
2024 J jnl
Transformers on Markov Data: Constant Depth Suffices.
CoRR
Nived Rajaraman, Marco Bondaschi, Kannan Ramchandran, Michael Gastpar, Ashok Vardhan Makkuva
2024 A* conf
Transformers on Markov data: Constant depth suffices.
NeurIPS
Nived Rajaraman, Marco Bondaschi, Ashok Vardhan Makkuva, Kannan Ramchandran, Michael Gastpar
2023 J jnl
LASER: Linear Compression in Wireless Distributed Optimization.
CoRR
Ashok Vardhan Makkuva, Marco Bondaschi, Thijs Vogels, Martin Jaggi, Hyeji Kim, Michael C. Gastpar
2022 J jnl
A Revisitation of Low-Rate Bounds on the Reliability Function of Discrete Memoryless Channels for List Decoding.
IEEE Trans. Inf. Theory
Marco Bondaschi, Marco Dalai
2022 B conf
Alpha-NML Universal Predictors.
ISIT
Marco Bondaschi, Michael Gastpar
2022 J jnl
Alpha-NML Universal Predictors.
CoRR
Marco Bondaschi, Michael Gastpar
2022 J jnl
Mismatched Decoding Reliability Function at Zero Rate.
IEEE Trans. Inf. Theory
Marco Bondaschi, Albert Guillén i Fàbregas, Marco Dalai
2021 B conf
Zero-rate Reliability Function for Mismatched Decoding.
ISIT
Marco Bondaschi, Albert Guillén i Fàbregas, Marco Dalai
2021 J jnl
Zero-rate reliability function for mismatched decoding.
CoRR
Marco Bondaschi, Albert Guillén i Fàbregas, Marco Dalai
2020 B conf
Revisiting Zero-Rate Bounds on the Reliability Function of Discrete Memoryless Channels.
ISIT
Marco Bondaschi, Marco Dalai
2019 J jnl
Revisiting zero-rate bounds on the reliability function of discrete memoryless channels.
CoRR
Marco Bondaschi, Marco Dalai