Ekdeep Singh Lubana

Publication Activity (10 Years)

Years Active: 2018-2024
Publications (10 Years): 35

Top Topics

Diffusion Models

Influence Maximization

Supervised Learning

Top Venues

Publications

Samyak Jain, Ekdeep Singh Lubana, Kemal Oksuz, Tom Joy, Philip H. S. Torr, Amartya Sanyal, Puneet K. Dokania
What Makes and Breaks Safety Fine-tuning? A Mechanistic Study. CoRR (2024)
Samyak Jain, Robert Kirk, Ekdeep Singh Lubana, Robert P. Dick, Hidenori Tanaka, Tim Rocktäschel, Edward Grefenstette, David Scott Krueger
Mechanistically analyzing the effects of fine-tuning on procedurally defined tasks. ICLR (2024)
Usman Anwar, Abulhair Saparov, Javier Rando, Daniel Paleka, Miles Turpin, Peter Hase, Ekdeep Singh Lubana, Erik Jenner, Stephen Casper, Oliver Sourbut, Benjamin L. Edelman, Zhaowei Zhang, Mario Günther, Anton Korinek, José Hernández-Orallo, Lewis Hammond, Eric J. Bigelow, Alexander Pan, Lauro Langosco, Tomasz Korbak, Heidi Zhang, Ruiqi Zhong, Seán Ó hÉigeartaigh, Gabriel Recchia, Giulio Corsi, Alan Chan, Markus Anderljung, Lilian Edwards, Yoshua Bengio, Danqi Chen, Samuel Albanie, Tegan Maharaj, Jakob N. Foerster, Florian Tramèr, He He, Atoosa Kasirzadeh, Yejin Choi, David Krueger
Foundational Challenges in Assuring Alignment and Safety of Large Language Models. CoRR (2024)
Mikail Khona, Maya Okawa, Jan Hula, Rahul Ramesh, Kento Nishi, Robert P. Dick, Ekdeep Singh Lubana, Hidenori Tanaka
Towards an Understanding of Stepwise Inference in Transformers: A Synthetic Graph Navigation Model. CoRR (2024)
Eric J. Bigelow, Ekdeep Singh Lubana, Robert P. Dick, Hidenori Tanaka, Tomer D. Ullman
In-Context Learning Dynamics with Random Binary Sequences. ICLR (2024)
Core Francisco Park, Maya Okawa, Andrew Lee, Ekdeep Singh Lubana, Hidenori Tanaka
Emergence of Hidden Capabilities: Exploring Learning Dynamics in Concept Space. CoRR (2024)
Cindy Wu, Ekdeep Singh Lubana, Bruno Kacper Mlodozeniec, Robert Kirk, David Krueger
What Mechanisms Does Knowledge Distillation Distill? UniReps (2023)
Ekdeep Singh Lubana, Eric J. Bigelow, Robert P. Dick, David Krueger, Hidenori Tanaka
Mechanistic Mode Connectivity. ICML (2023)
Eric J. Bigelow, Ekdeep Singh Lubana, Robert P. Dick, Hidenori Tanaka, Tomer D. Ullman
In-Context Learning Dynamics with Random Binary Sequences. CoRR (2023)
Maya Okawa, Ekdeep Singh Lubana, Robert P. Dick, Hidenori Tanaka
Compositional Abilities Emerge Multiplicatively: Exploring Diffusion Models on a Synthetic Task. CoRR (2023)
Maya Okawa, Ekdeep Singh Lubana, Robert P. Dick, Hidenori Tanaka
Compositional Abilities Emerge Multiplicatively: Exploring Diffusion Models on a Synthetic Task. NeurIPS (2023)
Ekdeep Singh Lubana, Johann Brehmer, Pim de Haan, Taco Cohen
FoMo Rewards: Can we cast foundation models as reward functions? CoRR (2023)
Ziyin Liu, Ekdeep Singh Lubana, Masahito Ueda, Hidenori Tanaka
What shapes the loss landscape of self supervised learning? ICLR (2023)
Rahul Ramesh, Mikail Khona, Robert P. Dick, Hidenori Tanaka, Ekdeep Singh Lubana
How Capable Can a Transformer Become? A Study on Synthetic, Interpretable Tasks. CoRR (2023)
Samyak Jain, Robert Kirk, Ekdeep Singh Lubana, Robert P. Dick, Hidenori Tanaka, Edward Grefenstette, Tim Rocktäschel, David Scott Krueger
Mechanistically analyzing the effects of fine-tuning on procedurally defined tasks. CoRR (2023)
Ekdeep Singh Lubana, Chi Ian Tang, Fahim Kawsar, Robert P. Dick, Akhil Mathur
Orchestra: Unsupervised Federated Learning via Globally Consistent Clustering. CoRR (2022)
Puja Trivedi, Ekdeep Singh Lubana, Mark Heimann, Danai Koutra, Jayaraman J. Thiagarajan
Analyzing Data-Centric Properties for Graph Contrastive Learning. NeurIPS (2022)
Ekdeep Singh Lubana, Eric J. Bigelow, Robert P. Dick, David Krueger, Hidenori Tanaka
Mechanistic Mode Connectivity. CoRR (2022)
Ekdeep Singh Lubana, Puja Trivedi, Danai Koutra, Robert P. Dick
How do Quadratic Regularizers Prevent Catastrophic Forgetting: The Role of Interpolation. CoLLAs (2022)
Ekdeep Singh Lubana, Chi Ian Tang, Fahim Kawsar, Robert P. Dick, Akhil Mathur
Orchestra: Unsupervised Federated Learning via Globally Consistent Clustering. ICML (2022)
Ziyin Liu, Ekdeep Singh Lubana, Masahito Ueda, Hidenori Tanaka
What shapes the loss landscape of self-supervised learning? CoRR (2022)
Puja Trivedi, Ekdeep Singh Lubana, Mark Heimann, Danai Koutra, Jayaraman J. Thiagarajan
Analyzing Data-Centric Properties for Contrastive Learning on Graphs. CoRR (2022)
Puja Trivedi, Ekdeep Singh Lubana, Yujun Yan, Yaoqing Yang, Danai Koutra
Augmentations in Graph Contrastive Learning: Current Methodological Flaws & Towards Better Practices. WWW (2022)
Ekdeep Singh Lubana, Puja Trivedi, Robert P. Dick
Rethinking Quadratic Regularizers: Explicit Movement Regularization for Continual Learning. CoRR (2021)
Puja Trivedi, Ekdeep Singh Lubana, Yujun Yan, Yaoqing Yang, Danai Koutra
Augmentations in Graph Contrastive Learning: Current Methodological Flaws & Towards Better Practices. CoRR (2021)
Ekdeep Singh Lubana, Robert P. Dick, Hidenori Tanaka
Beyond BatchNorm: Towards a General Understanding of Normalization in Deep Learning. CoRR (2021)
Ekdeep Singh Lubana, Robert P. Dick, Hidenori Tanaka
Beyond BatchNorm: Towards a Unified Understanding of Normalization in Deep Learning. NeurIPS (2021)
Ekdeep Singh Lubana, Robert P. Dick
A Gradient Flow Framework For Analyzing Network Pruning. ICLR (2021)
Benjamin Simpson, Ekdeep Singh Lubana, Yuchen Liu, Robert P. Dick
Intelligent Scene Caching to Improve Accuracy for Energy-Constrained Embedded Vision. CVPR Workshops (2020)
Ekdeep Singh Lubana, Robert P. Dick
A Gradient Flow Framework For Analyzing Network Pruning. CoRR (2020)
Ekdeep Singh Lubana, Puja Trivedi, Conrad D. Hougen, Robert P. Dick, Alfred O. Hero III
OrthoReg: Robust Network Pruning Using Orthonormality Regularization. CoRR (2020)
Ekdeep Singh Lubana, Vinayak Aggarwal, Robert P. Dick
Machine Foveation: An Application-Aware Compressive Sensing Framework. DCC (2019)
Ekdeep Singh Lubana, Robert P. Dick, Vinayak Aggarwal, Pyari Mohan Pradhan
Minimalistic Image Signal Processing for Deep Learning Applications. ICIP (2019)
Ekdeep Singh Lubana, Mangesh Gurav, Maryam Shojaei Baghini
Snap: Chlorophyll Concentration Calculator Using RAW Images of Leaves. IEEE SENSORS (2018)
Ekdeep Singh Lubana, Robert P. Dick
Digital Foveation: An Energy-Aware Machine Vision Framework. IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 37 (11) (2018)