Yassir Akram

12 papers A* 4Journal 8
YearRankTypeTitle / Venue / Authors
2025 A* conf
Attention as a Hypernetwork.
ICLR
Simon Schug, Seijin Kobayashi, Yassir Akram, João Sacramento, Razvan Pascanu
2025 A* conf
Learning Randomized Algorithms with Transformers.
ICLR
Johannes von Oswald, Seijin Kobayashi, Yassir Akram, Angelika Steger
2025 J jnl
Scale leads to compositional generalization.
CoRR
Florian Redhardt, Yassir Akram, Simon Schug
2024 J jnl
Attention as a Hypernetwork.
CoRR
Simon Schug, Seijin Kobayashi, Yassir Akram, João Sacramento, Razvan Pascanu
2024 A* conf
Discovering modular solutions that generalize compositionally.
ICLR
Simon Schug, Seijin Kobayashi, Yassir Akram, Maciej Wolczyk, Alexandra Maria Proca, Johannes von Oswald, Razvan Pascanu, João Sacramento, Angelika Steger
2024 J jnl
Learning Randomized Algorithms with Transformers.
CoRR
Johannes von Oswald, Seijin Kobayashi, Yassir Akram, Angelika Steger
2024 A* conf
Weight decay induces low-rank attention layers.
NeurIPS
Seijin Kobayashi, Yassir Akram, Johannes von Oswald
2024 J jnl
Weight decay induces low-rank attention layers.
CoRR
Seijin Kobayashi, Yassir Akram, Johannes von Oswald
2024 J jnl
When can transformers compositionally generalize in-context?
CoRR
Seijin Kobayashi, Simon Schug, Yassir Akram, Florian Redhardt, Johannes von Oswald, Razvan Pascanu, Guillaume Lajoie, João Sacramento
2023 J jnl
Discovering modular solutions that generalize compositionally.
CoRR
Simon Schug, Seijin Kobayashi, Yassir Akram, Maciej Wolczyk, Alexandra Maria Proca, Johannes von Oswald, Razvan Pascanu, João Sacramento, Angelika Steger
2023 J jnl
Gated recurrent neural networks discover attention.
CoRR
Nicolas Zucchet, Seijin Kobayashi, Yassir Akram, Johannes von Oswald, Maxime Larcher, Angelika Steger, João Sacramento
2022 J jnl
Random initialisations performing above chance and how to find them.
CoRR
Frederik Benzing, Simon Schug, Robert Meier, Johannes von Oswald, Yassir Akram, Nicolas Zucchet, Laurence Aitchison, Angelika Steger