Ekdeep Singh Lubana

73 papers A* 21B 2Journal 45Unranked 5

Year	Rank	Type	Title / Venue / Authors
2026	J	`jnl`	Features as Rewards: Scalable Supervision for Open-Ended Tasks via Interpretability. CoRR Aaditya Vikram Prasad, Connor Watts, Jack Merullo, Dhruvil Gala, Owen Lewis, Thomas McGrath, Ekdeep Singh Lubana
2026	J	`jnl`	The Shape of Beliefs: Geometry, Dynamics, and Interventions along Representation Manifolds of Language Models' Posteriors. CoRR Raphaël Sarfati, Eric J. Bigelow, Daniel Wurgaft, Jack Merullo, Atticus Geiger, Owen Lewis, Tom McGrath, Ekdeep Singh Lubana
2025	A*	`conf`	A Percolation Model of Emergence: Analyzing Transformers Trained on a Formal Language. ICLR Ekdeep Singh Lubana, Kyogo Kawaguchi, Robert P. Dick, Hidenori Tanaka
2025	—	`conf`	Analyzing (In)Abilities of SAEs via Formal Languages. NAACL (Long Papers) Abhinav Menon, Manish Shrivastava, David Krueger, Ekdeep Singh Lubana
2025	A*	`conf`	Archetypal SAE: Adaptive and Stable Dictionary Learning for Concept Extraction in Large Vision Models. ICML Thomas Fel, Ekdeep Singh Lubana, Jacob S. Prince, Matthew Kowal, Victor Boutin, Isabel Papadimitriou, Binxu Wang, Martin Wattenberg, Demba E. Ba, Talia Konkle
2025	J	`jnl`	Archetypal SAE: Adaptive and Stable Dictionary Learning for Concept Extraction in Large Vision Models. CoRR Thomas Fel, Ekdeep Singh Lubana, Jacob S. Prince, Matthew Kowal, Victor Boutin, Isabel Papadimitriou, Binxu Wang, Martin Wattenberg, Demba E. Ba, Talia Konkle
2025	J	`jnl`	Are language models aware of the road not taken? Token-level uncertainty and hidden state dynamics. CoRR Amir Zur, Atticus Geiger, Ekdeep Singh Lubana, Eric J. Bigelow
2025	J	`jnl`	Belief Dynamics Reveal the Dual Nature of In-Context Learning and Activation Steering. CoRR Eric J. Bigelow, Daniel Wurgaft, YingQiao Wang, Noah D. Goodman, Tomer D. Ullman, Hidenori Tanaka, Ekdeep Singh Lubana
2025	A*	`conf`	Competition Dynamics Shape Algorithmic Phases of In-Context Learning. ICLR Core Francisco Park, Ekdeep Singh Lubana, Hidenori Tanaka
2025	J	`jnl`	Detecting High-Stakes Interactions with Activation Probes. CoRR Alex McKenzie, Urja Pawar, Phil Blandfort, William Bankes, David Krueger, Ekdeep Singh Lubana, Dmitrii Krasheninnikov
2025	J	`jnl`	Emergence of Hierarchical Emotion Organization in Large Language Models. CoRR Bo Zhao, Maya Okawa, Eric J. Bigelow, Rose Yu, Tomer D. Ullman, Ekdeep Singh Lubana, Hidenori Tanaka
2025	J	`jnl`	Evaluating Sparse Autoencoders: From Shallow Design to Matching Pursuit. CoRR Valérie Costa, Thomas Fel, Ekdeep Singh Lubana, Bahareh Tolooshams, Demba E. Ba
2025	J	`jnl`	From Flat to Hierarchical: Extracting Sparse Representations with Matching Pursuit. CoRR Valérie Costa, Thomas Fel, Ekdeep Singh Lubana, Bahareh Tolooshams, Demba E. Ba
2025	J	`jnl`	From Isolation to Entanglement: When Do Interpretability Methods Identify and Disentangle Known Concepts? CoRR Aaron Mueller, Andrew Lee, Shruti Joshi, Ekdeep Singh Lubana, Dhanya Sridhar, Patrik Reizinger
2025	J	`jnl`	How Do LLMs Persuade? Linear Probes Can Uncover Persuasion Dynamics in Multi-Turn Conversations. CoRR Brandon Jaipersaud, David Krueger, Ekdeep Singh Lubana
2025	A*	`conf`	ICLR: In-Context Learning of Representations. ICLR Core Francisco Park, Andrew Lee, Ekdeep Singh Lubana, Yongyi Yang, Maya Okawa, Kento Nishi, Martin Wattenberg, Hidenori Tanaka
2025	J	`jnl`	ICLR: In-Context Learning of Representations. CoRR Core Francisco Park, Andrew Lee, Ekdeep Singh Lubana, Yongyi Yang, Maya Okawa, Kento Nishi, Martin Wattenberg, Hidenori Tanaka
2025	J	`jnl`	In-Context Learning Strategies Emerge Rationally. CoRR Daniel Wurgaft, Ekdeep Singh Lubana, Core Francisco Park, Hidenori Tanaka, Gautam Reddy, Noah D. Goodman
2025	J	`jnl`	Into the Rabbit Hull: From Task-Relevant Concepts in DINO to Minkowski Geometry. CoRR Thomas Fel, Binxu Wang, Michael A. Lepori, Matthew Kowal, Andrew Lee, Randall Balestriero, Sonia Joseph, Ekdeep Singh Lubana, Talia Konkle, Demba E. Ba, Martin Wattenberg
2025	J	`jnl`	Priors in Time: Missing Inductive Biases for Language Model Interpretability. CoRR Ekdeep Singh Lubana, Can Rager, Sai Sumedh R. Hindupur, Valérie Costa, Greta Tuckute, Oam Patel, Sonia Krishna Murthy, Thomas Fel, Daniel Wurgaft, Eric J. Bigelow, Johnny Lin, Demba E. Ba, Martin Wattenberg, Fernanda B. Viégas, Melanie Weber, Aaron Mueller
2025	J	`jnl`	Projecting Assumptions: The Duality Between Sparse Autoencoders and Concept Geometry. CoRR Sai Sumedh R. Hindupur, Ekdeep Singh Lubana, Thomas Fel, Demba E. Ba
2025	A*	`conf`	Representation Shattering in Transformers: A Synthetic Study with Knowledge Editing. ICML Kento Nishi, Rahul Ramesh, Maya Okawa, Mikail Khona, Hidenori Tanaka, Ekdeep Singh Lubana
2025	A*	`conf`	Swing-by Dynamics in Concept Learning and Compositional Generalization. ICLR Yongyi Yang, Core Francisco Park, Ekdeep Singh Lubana, Maya Okawa, Wei Hu, Hidenori Tanaka
2025	J	`jnl`	The Impact of Off-Policy Training Data on Probe Generalisation. CoRR Nathalie Kirch, Samuel Dower, Adrians Skapars, Ekdeep Singh Lubana, Dmitrii Krasheninnikov
2025	J	`jnl`	Uncovering Conceptual Blindspots in Generative Image Models Using Sparse Autoencoders. CoRR Matyas Bohacek, Thomas Fel, Maneesh Agrawala, Ekdeep Singh Lubana
2024	J	`jnl`	A Percolation Model of Emergence: Analyzing Transformers Trained on a Formal Language. CoRR Ekdeep Singh Lubana, Kyogo Kawaguchi, Robert P. Dick, Hidenori Tanaka
2024	A*	`conf`	Abrupt Learning in Transformers: A Case Study on Matrix Completion. NeurIPS Pulkit Gopalani, Ekdeep Singh Lubana, Wei Hu
2024	J	`jnl`	Abrupt Learning in Transformers: A Case Study on Matrix Completion. CoRR Pulkit Gopalani, Ekdeep Singh Lubana, Wei Hu
2024	J	`jnl`	Analyzing (In)Abilities of SAEs via Formal Languages. CoRR Abhinav Menon, Manish Shrivastava, David Krueger, Ekdeep Singh Lubana
2024	J	`jnl`	Competition Dynamics Shape Algorithmic Phases of In-Context Learning. CoRR Core Francisco Park, Ekdeep Singh Lubana, Itamar Pres, Hidenori Tanaka
2024	A*	`conf`	Compositional Capabilities of Autoregressive Transformers: A Study on Synthetic, Interpretable Tasks. ICML Rahul Ramesh, Ekdeep Singh Lubana, Mikail Khona, Robert P. Dick, Hidenori Tanaka
2024	J	`jnl`	Dynamics of Concept Learning and Compositional Generalization. CoRR Yongyi Yang, Core Francisco Park, Ekdeep Singh Lubana, Maya Okawa, Wei Hu, Hidenori Tanaka
2024	A*	`conf`	Emergence of Hidden Capabilities: Exploring Learning Dynamics in Concept Space. NeurIPS Core Francisco Park, Maya Okawa, Andrew Lee, Ekdeep Singh Lubana, Hidenori Tanaka
2024	J	`jnl`	Emergence of Hidden Capabilities: Exploring Learning Dynamics in Concept Space. CoRR Core Francisco Park, Maya Okawa, Andrew Lee, Ekdeep Singh Lubana, Hidenori Tanaka
2024	J	`jnl`	Foundational Challenges in Assuring Alignment and Safety of Large Language Models. CoRR Usman Anwar, Abulhair Saparov, Javier Rando, Daniel Paleka, Miles Turpin, Peter Hase, Ekdeep Singh Lubana, Erik Jenner, Stephen Casper, Oliver Sourbut, Benjamin L. Edelman, Zhaowei Zhang, Mario Günther, Anton Korinek, José Hernández-Orallo, Lewis Hammond, Eric J. Bigelow, Alexander Pan, Lauro Langosco, Tomasz Korbak, Heidi C. Zhang, Ruiqi Zhong, Seán Ó hÉigeartaigh, Gabriel Recchia, Giulio Corsi, Alan Chan, Markus Anderljung, Lilian Edwards, Yoshua Bengio, Danqi Chen, Samuel Albanie, Tegan Maharaj, Jakob N. Foerster, Florian Tramèr, He He, Atoosa Kasirzadeh, Yejin Choi, David Krueger
2024	J	`jnl`	Foundational Challenges in Assuring Alignment and Safety of Large Language Models. Trans. Mach. Learn. Res. Usman Anwar, Abulhair Saparov, Javier Rando, Daniel Paleka, Miles Turpin, Peter Hase, Ekdeep Singh Lubana, Erik Jenner, Stephen Casper, Oliver Sourbut, Benjamin L. Edelman, Zhaowei Zhang, Mario Günther, Anton Korinek, José Hernández-Orallo, Lewis Hammond, Eric J. Bigelow, Alexander Pan, Lauro Langosco, Tomasz Korbak, Heidi Chenyu Zhang, Ruiqi Zhong, Seán Ó hÉigeartaigh, Gabriel Recchia, Giulio Corsi, Alan Chan, Markus Anderljung, Lilian Edwards, Aleksandar Petrov, Christian Schröder de Witt, Sumeet Ramesh Motwani, Yoshua Bengio, Danqi Chen, Philip Torr, Samuel Albanie, Tegan Maharaj, Jakob Nicolaus Foerster, Florian Tramèr, He He, Atoosa Kasirzadeh, Yejin Choi, David Krueger
2024	A*	`conf`	In-Context Learning Dynamics with Random Binary Sequences. ICLR Eric J. Bigelow, Ekdeep Singh Lubana, Robert P. Dick, Hidenori Tanaka, Tomer D. Ullman
2024	A*	`conf`	Mechanistically analyzing the effects of fine-tuning on procedurally defined tasks. ICLR Samyak Jain, Robert Kirk, Ekdeep Singh Lubana, Robert P. Dick, Hidenori Tanaka, Tim Rocktäschel, Edward Grefenstette, David Scott Krueger
2024	J	`jnl`	Representation Shattering in Transformers: A Synthetic Study with Knowledge Editing. CoRR Kento Nishi, Maya Okawa, Rahul Ramesh, Mikail Khona, Ekdeep Singh Lubana, Hidenori Tanaka
2024	J	`jnl`	Towards Reliable Evaluation of Behavior Steering Interventions in LLMs. CoRR Itamar Pres, Laura Ruis, Ekdeep Singh Lubana, David Krueger
2024	A*	`conf`	Towards an Understanding of Stepwise Inference in Transformers: A Synthetic Graph Navigation Model. ICML Mikail Khona, Maya Okawa, Jan Hula, Rahul Ramesh, Kento Nishi, Robert P. Dick, Ekdeep Singh Lubana, Hidenori Tanaka
2024	J	`jnl`	Towards an Understanding of Stepwise Inference in Transformers: A Synthetic Graph Navigation Model. CoRR Mikail Khona, Maya Okawa, Jan Hula, Rahul Ramesh, Kento Nishi, Robert P. Dick, Ekdeep Singh Lubana, Hidenori Tanaka
2024	A*	`conf`	What Makes and Breaks Safety Fine-tuning? A Mechanistic Study. NeurIPS Samyak Jain, Ekdeep Singh Lubana, Kemal Oksuz, Tom Joy, Philip Torr, Amartya Sanyal, Puneet K. Dokania
2024	J	`jnl`	What Makes and Breaks Safety Fine-tuning? A Mechanistic Study. CoRR Samyak Jain, Ekdeep Singh Lubana, Kemal Oksuz, Tom Joy, Philip H. S. Torr, Amartya Sanyal, Puneet K. Dokania
2023	A*	`conf`	Compositional Abilities Emerge Multiplicatively: Exploring Diffusion Models on a Synthetic Task. NeurIPS Maya Okawa, Ekdeep Singh Lubana, Robert P. Dick, Hidenori Tanaka
2023	J	`jnl`	Compositional Abilities Emerge Multiplicatively: Exploring Diffusion Models on a Synthetic Task. CoRR Maya Okawa, Ekdeep Singh Lubana, Robert P. Dick, Hidenori Tanaka
2023	J	`jnl`	FoMo Rewards: Can we cast foundation models as reward functions? CoRR Ekdeep Singh Lubana, Johann Brehmer, Pim de Haan, Taco Cohen
2023	J	`jnl`	How Capable Can a Transformer Become? A Study on Synthetic, Interpretable Tasks. CoRR Rahul Ramesh, Mikail Khona, Robert P. Dick, Hidenori Tanaka, Ekdeep Singh Lubana
2023	J	`jnl`	In-Context Learning Dynamics with Random Binary Sequences. CoRR Eric J. Bigelow, Ekdeep Singh Lubana, Robert P. Dick, Hidenori Tanaka, Tomer D. Ullman
2023	A*	`conf`	Mechanistic Mode Connectivity. ICML Ekdeep Singh Lubana, Eric J. Bigelow, Robert P. Dick, David Scott Krueger, Hidenori Tanaka
2023	J	`jnl`	Mechanistically analyzing the effects of fine-tuning on procedurally defined tasks. CoRR Samyak Jain, Robert Kirk, Ekdeep Singh Lubana, Robert P. Dick, Hidenori Tanaka, Edward Grefenstette, Tim Rocktäschel, David Scott Krueger
2023	—	`conf`	What Mechanisms Does Knowledge Distillation Distill? UniReps Cindy Wu, Ekdeep Singh Lubana, Bruno Kacper Mlodozeniec, Robert Kirk, David Krueger
2023	A*	`conf`	What shapes the loss landscape of self supervised learning? ICLR Liu Ziyin, Ekdeep Singh Lubana, Masahito Ueda, Hidenori Tanaka
2022	J	`jnl`	Analyzing Data-Centric Properties for Contrastive Learning on Graphs. CoRR Puja Trivedi, Ekdeep Singh Lubana, Mark Heimann, Danai Koutra, Jayaraman J. Thiagarajan
2022	A*	`conf`	Analyzing Data-Centric Properties for Graph Contrastive Learning. NeurIPS Puja Trivedi, Ekdeep Singh Lubana, Mark Heimann, Danai Koutra, Jayaraman J. Thiagarajan
2022	A*	`conf`	Augmentations in Graph Contrastive Learning: Current Methodological Flaws & Towards Better Practices. WWW Puja Trivedi, Ekdeep Singh Lubana, Yujun Yan, Yaoqing Yang, Danai Koutra
2022	—	`conf`	How do Quadratic Regularizers Prevent Catastrophic Forgetting: The Role of Interpolation. CoLLAs Ekdeep Singh Lubana, Puja Trivedi, Danai Koutra, Robert P. Dick
2022	J	`jnl`	Mechanistic Mode Connectivity. CoRR Ekdeep Singh Lubana, Eric J. Bigelow, Robert P. Dick, David Scott Krueger, Hidenori Tanaka
2022	A*	`conf`	Orchestra: Unsupervised Federated Learning via Globally Consistent Clustering. ICML Ekdeep Singh Lubana, Chi Ian Tang, Fahim Kawsar, Robert P. Dick, Akhil Mathur
2022	J	`jnl`	Orchestra: Unsupervised Federated Learning via Globally Consistent Clustering. CoRR Ekdeep Singh Lubana, Chi Ian Tang, Fahim Kawsar, Robert P. Dick, Akhil Mathur
2022	J	`jnl`	What shapes the loss landscape of self-supervised learning? CoRR Liu Ziyin, Ekdeep Singh Lubana, Masahito Ueda, Hidenori Tanaka
2021	A*	`conf`	A Gradient Flow Framework For Analyzing Network Pruning. ICLR Ekdeep Singh Lubana, Robert P. Dick
2021	J	`jnl`	Augmentations in Graph Contrastive Learning: Current Methodological Flaws & Towards Better Practices. CoRR Puja Trivedi, Ekdeep Singh Lubana, Yujun Yan, Yaoqing Yang, Danai Koutra
2021	J	`jnl`	Beyond BatchNorm: Towards a General Understanding of Normalization in Deep Learning. CoRR Ekdeep Singh Lubana, Robert P. Dick, Hidenori Tanaka
2021	A*	`conf`	Beyond BatchNorm: Towards a Unified Understanding of Normalization in Deep Learning. NeurIPS Ekdeep Singh Lubana, Robert P. Dick, Hidenori Tanaka
2021	J	`jnl`	Rethinking Quadratic Regularizers: Explicit Movement Regularization for Continual Learning. CoRR Ekdeep Singh Lubana, Puja Trivedi, Robert P. Dick
2020	J	`jnl`	A Gradient Flow Framework For Analyzing Network Pruning. CoRR Ekdeep Singh Lubana, Robert P. Dick
2020	—	`conf`	Intelligent Scene Caching to Improve Accuracy for Energy-Constrained Embedded Vision. CVPR Workshops Benjamin Simpson, Ekdeep Singh Lubana, Yuchen Liu, Robert P. Dick
2020	J	`jnl`	OrthoReg: Robust Network Pruning Using Orthonormality Regularization. CoRR Ekdeep Singh Lubana, Puja Trivedi, Conrad D. Hougen, Robert P. Dick, Alfred O. Hero III
2019	B	`conf`	Machine Foveation: An Application-Aware Compressive Sensing Framework. DCC Ekdeep Singh Lubana, Vinayak Aggarwal, Robert P. Dick
2019	B	`conf`	Minimalistic Image Signal Processing for Deep Learning Applications. ICIP Ekdeep Singh Lubana, Robert P. Dick, Vinayak Aggarwal, Pyari Mohan Pradhan
2018	J	`jnl`	Digital Foveation: An Energy-Aware Machine Vision Framework. IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. Ekdeep Singh Lubana, Robert P. Dick
2018	—	`conf`	Snap: Chlorophyll Concentration Calculator Using RAW Images of Leaves. IEEE SENSORS Ekdeep Singh Lubana, Mangesh Gurav, Maryam Shojaei Baghini