Piotr Nawrot

12 papers A* 2Journal 8Unranked 2
YearRankTypeTitle / Venue / Authors
2025 J jnl
Fast and Expressive Multi-Token Prediction with Probabilistic Circuits.
CoRR
Andreas Grivas, Lorenzo Loconte, Emile van Krieken, Piotr Nawrot, Yu Zhao, Euan Wielewski, Pasquale Minervini, Edoardo Maria Ponti, Antonio Vergari
2025 J jnl
Inference-Time Hyper-Scaling with KV Cache Compression.
CoRR
Adrian Lancucki, Konrad Staniszewski, Piotr Nawrot, Edoardo M. Ponti
2025 J jnl
The Sparse Frontier: Sparse Attention Trade-offs in Transformer LLMs.
CoRR
Piotr Nawrot, Robert Li, Renjie Huang, Sebastian Ruder, Kelly Marchisio, Edoardo M. Ponti
2024 A* conf
Dynamic Memory Compression: Retrofitting LLMs for Accelerated Inference.
ICML
Piotr Nawrot, Adrian Lancucki, Marcin Chochowski, David Tarjan, Edoardo M. Ponti
2024 J jnl
Dynamic Memory Compression: Retrofitting LLMs for Accelerated Inference.
CoRR
Piotr Nawrot, Adrian Lancucki, Marcin Chochowski, David Tarjan, Edoardo M. Ponti
2023 — conf
Efficient Transformers with Dynamic Token Pooling.
ACL (1)
Piotr Nawrot, Jan Chorowski, Adrian Lancucki, Edoardo Maria Ponti
2023 A* conf
No Train No Gain: Revisiting Efficient Training Algorithms For Transformer-based Language Models.
NeurIPS
Jean Kaddour, Oscar Key, Piotr Nawrot, Pasquale Minervini, Matt J. Kusner
2023 J jnl
No Train No Gain: Revisiting Efficient Training Algorithms For Transformer-based Language Models.
CoRR
Jean Kaddour, Oscar Key, Piotr Nawrot, Pasquale Minervini, Matt J. Kusner
2023 J jnl
nanoT5: A PyTorch Framework for Pre-training and Fine-tuning T5-style Models with Limited Resources.
CoRR
Piotr Nawrot
2022 J jnl
Efficient Transformers with Dynamic Token Pooling.
CoRR
Piotr Nawrot, Jan Chorowski, Adrian Lancucki, Edoardo M. Ponti
2022 — conf
Hierarchical Transformers Are More Efficient Language Models.
NAACL-HLT (Findings)
Piotr Nawrot, Szymon Tworkowski, Michal Tyrolski, Lukasz Kaiser, Yuhuai Wu, Christian Szegedy, Henryk Michalewski
2021 J jnl
Hierarchical Transformers Are More Efficient Language Models.
CoRR
Piotr Nawrot, Szymon Tworkowski, Michal Tyrolski, Lukasz Kaiser, Yuhuai Wu, Christian Szegedy, Henryk Michalewski