Matteo Pagliardini

29 papers A* 8C 1Journal 18Unranked 2

Year	Rank	Type	Title / Venue / Authors
2026	J	`jnl`	Leveraging the True Depth of LLMs. Trans. Mach. Learn. Res. Ramón Calvo González, Daniele Paliotta, Matteo Pagliardini, Martin Jaggi, François Fleuret
2025	J	`jnl`	Benchmarking Optimizers for Large Language Model Pretraining. CoRR Andrei Semenov, Matteo Pagliardini, Martin Jaggi
2025	J	`jnl`	CWM: An Open-Weights LLM for Research on Code Generation with World Models. CoRR FAIR CodeGen team, Jade Copet, Quentin Carbonneaux, Gal Cohen, Jonas Gehring, Jacob Kahn, Jannik Kossen, Felix Kreuk, Emily McMilin, Michel Meyer, Yuxiang Wei, David Zhang, Kunhao Zheng, Jordi Armengol-Estapé, Pedram Bashiri, Maximilian Beck, Pierre Chambon, Abhishek Charnalia, Chris Cummins, Juliette Decugis, Zacharias V. Fisches, François Fleuret, Fabian Gloeckle, Alex Gu, Michael Hassid, Daniel Haziza, Badr Youbi Idrissi, Christian Keller, Rahul Kindi, Hugh Leather, Gallil Maimon, Aram H. Markosyan, Francisco Massa, Pierre-Emmanuel Mazaré, Vegard Mella, Naila Murray, Keyur Muzumdar, Peter W. O'Hearn, Matteo Pagliardini, Dmitrii Pedchenko, Tal Remez, Volker Seeker, Marco Selvi, Oren Sultan, Sida Wang, Luca Wehrstedt, Ori Yoran, Lingming Zhang, Taco Cohen, Yossi Adi, Gabriel Synnaeve
2025	A*	`conf`	CoTFormer: A Chain of Thought Driven Architecture with Budget-Adaptive Computation Cost at Inference. ICLR Amirkeivan Mohtashami, Matteo Pagliardini, Martin Jaggi
2025	J	`jnl`	Leveraging the true depth of LLMs. CoRR Ramón Calvo González, Daniele Paliotta, Matteo Pagliardini, Martin Jaggi, François Fleuret
2025	A*	`conf`	The AdEMAMix Optimizer: Better, Faster, Older. ICLR Matteo Pagliardini, Pierre Ablin, David Grangier
2025	J	`jnl`	Thinking Slow, Fast: Scaling Inference Compute with Distilled Reasoners. CoRR Daniele Paliotta, Junxiong Wang, Matteo Pagliardini, Kevin Y. Li, Aviv Bick, J. Zico Kolter, Albert Gu, François Fleuret, Tri Dao
2024	A*	`conf`	A Primal-Dual Approach to Solving Variational Inequalities with General Constraints. ICLR Tatjana Chavdarova, Tong Yang, Matteo Pagliardini, Michael I. Jordan
2024	A*	`conf`	DOGE: Domain Reweighting with Generalization Estimation. ICML Simin Fan, Matteo Pagliardini, Martin Jaggi
2024	A*	`conf`	DenseFormer: Enhancing Information Flow in Transformers via Depth Weighted Averaging. NeurIPS Matteo Pagliardini, Amirkeivan Mohtashami, François Fleuret, Martin Jaggi
2024	J	`jnl`	DenseFormer: Enhancing Information Flow in Transformers via Depth Weighted Averaging. CoRR Matteo Pagliardini, Amirkeivan Mohtashami, François Fleuret, Martin Jaggi
2024	J	`jnl`	The AdEMAMix Optimizer: Better, Faster, Older. CoRR Matteo Pagliardini, Pierre Ablin, David Grangier
2023	A*	`conf`	Agree to Disagree: Diversity through Disagreement for Better Transferability. ICLR Matteo Pagliardini, Martin Jaggi, François Fleuret, Sai Praneeth Karimireddy
2023	J	`jnl`	CoTFormer: More Tokens With Attention Make Up For Less Depth. CoRR Amirkeivan Mohtashami, Matteo Pagliardini, Martin Jaggi
2023	J	`jnl`	DoGE: Domain Reweighting with Generalization Estimation. CoRR Simin Fan, Matteo Pagliardini, Martin Jaggi
2023	A*	`conf`	Fast Attention Over Long Sequences With Dynamic Sparse Flash Attention. NeurIPS Matteo Pagliardini, Daniele Paliotta, Martin Jaggi, François Fleuret
2023	J	`jnl`	Faster Causal Attention Over Large Sequences Through Sparse Flash Attention. CoRR Matteo Pagliardini, Daniele Paliotta, Martin Jaggi, François Fleuret
2023	J	`jnl`	MEDITRON-70B: Scaling Medical Pretraining for Large Language Models. CoRR Zeming Chen, Alejandro Hernández-Cano, Angelika Romanou, Antoine Bonnet, Kyle Matoba, Francesco Salvi, Matteo Pagliardini, Simin Fan, Andreas Köpf, Amirkeivan Mohtashami, Alexandre Sallinen, Alireza Sakhaeirad, Vinitra Swamy, Igor Krawczuk, Deniz Bayazit, Axel Marmet, Syrielle Montariol, Mary-Anne Hartley, Martin Jaggi, Antoine Bosselut
2022	J	`jnl`	Agree to Disagree: Diversity through Disagreement for Better Transferability. CoRR Matteo Pagliardini, Martin Jaggi, François Fleuret, Sai Praneeth Karimireddy
2022	J	`jnl`	Improving Generalization via Uncertainty Driven Perturbations. CoRR Matteo Pagliardini, Gilberto Manunza, Martin Jaggi, Michael I. Jordan, Tatjana Chavdarova
2022	J	`jnl`	Revisiting the ACVI Method for Constrained Variational Inequalities. CoRR Tatjana Chavdarova, Matteo Pagliardini, Tong Yang, Michael I. Jordan
2021	A*	`conf`	Taming GANs with Lookahead-Minmax. ICLR Tatjana Chavdarova, Matteo Pagliardini, Sebastian U. Stich, François Fleuret, Martin Jaggi
2021	J	`jnl`	The Peril of Popular Deep Learning Uncertainty Estimation Methods. CoRR Yehao Liu, Matteo Pagliardini, Tatjana Chavdarova, Sebastian U. Stich
2020	J	`jnl`	Taming GANs with Lookahead. CoRR Tatjana Chavdarova, Matteo Pagliardini, Martin Jaggi, François Fleuret
2019	—	`conf`	Better Word Embeddings by Disentangling Contextual n-Gram Information. NAACL-HLT (1) Prakhar Gupta, Matteo Pagliardini, Martin Jaggi
2019	J	`jnl`	Better Word Embeddings by Disentangling Contextual n-Gram Information. CoRR Prakhar Gupta, Matteo Pagliardini, Martin Jaggi
2018	—	`conf`	Unsupervised Learning of Sentence Embeddings Using Compositional n-Gram Features. NAACL-HLT Matteo Pagliardini, Prakhar Gupta, Martin Jaggi
2017	J	`jnl`	Unsupervised Learning of Sentence Embeddings using Compositional n-Gram Features. CoRR Matteo Pagliardini, Prakhar Gupta, Martin Jaggi
2013	C	`conf`	Exemplar-Based Hole-Filling Technique for Multiple Dynamic Objects. PSIVT Matteo Pagliardini, Yasuhiro Akagi, Marcos Slomp, Ryo Furukawa, Ryusuke Sagawa, Hiroshi Kawasaki