Sidak Pal Singh

Publication Activity (10 Years)

Years Active: 2016-2024
Publications (10 Years): 30

Top Topics

Lipschitz Continuity

Theoretical Perspectives

Top Venues

Publications

Sidak Pal Singh, Linara Adilova, Michael Kamp, Asja Fischer, Bernhard Schölkopf, Thomas Hofmann
Landscaping Linear Mode Connectivity. CoRR (2024)
Danilo Dordevic, Vukasin Bozic, Joseph Thommes, Daniele Coppola, Sidak Pal Singh
Rethinking Attention: Exploring Shallow Feed-Forward Neural Networks as an Alternative to Attention Layers in Transformers (Student Abstract). AAAI (2024)
Grigory Khromov, Sidak Pal Singh
Some Fundamental Aspects about Lipschitz Continuity of Neural Networks. ICLR (2024)
Alexander Theus, Olin Geimer, Friedrich Wicke, Thomas Hofmann, Sotiris Anagnostidis, Sidak Pal Singh
Towards Meta-Pruning via Optimal Transport. ICLR (2024)
Alexander Theus, Olin Geimer, Friedrich Wicke, Thomas Hofmann, Sotiris Anagnostidis, Sidak Pal Singh
Towards Meta-Pruning via Optimal Transport. CoRR (2024)
Sidak Pal Singh, Bobby He, Thomas Hofmann, Bernhard Schölkopf
Hallmarks of Optimization Trajectories in Neural Networks and LLMs: The Lengths, Bends, and Dead Ends. CoRR (2024)
Giulia Lanzillotta, Sidak Pal Singh, Benjamin F. Grewe, Thomas Hofmann
Local vs Global continual learning. CoRR (2024)
Moritz Imfeld, Jacopo Graldi, Marco Giordano, Thomas Hofmann, Sotiris Anagnostidis, Sidak Pal Singh
Transformer Fusion with Optimal Transport. ICLR (2024)
Alison Pouplin, Hrittik Roy, Sidak Pal Singh, Georgios Arvanitidis
On the curvature of the loss landscape. CoRR (2023)
Moritz Imfeld, Jacopo Graldi, Marco Giordano, Thomas Hofmann, Sotiris Anagnostidis, Sidak Pal Singh
Transformer Fusion with Optimal Transport. CoRR (2023)
Grigory Khromov, Sidak Pal Singh
Some Fundamental Aspects about Lipschitz Continuity of Neural Network Functions. CoRR (2023)
Sidak Pal Singh, Thomas Hofmann, Bernhard Schölkopf
The Hessian perspective into the Nature of Convolutional Neural Networks. ICML (2023)
Giulia Lanzillotta, Sidak Pal Singh, Benjamin F. Grewe, Thomas Hofmann
Towards guarantees for parameter isolation in continual learning. CoRR (2023)
Sidak Pal Singh, Thomas Hofmann, Bernhard Schölkopf
The Hessian perspective into the Nature of Convolutional Neural Networks. CoRR (2023)
Sidak Pal Singh, Aurélien Lucchi, Thomas Hofmann, Bernhard Schölkopf
Phenomenology of Double Descent in Finite-Width Neural Networks. CoRR (2022)
Sidak Pal Singh, Aurélien Lucchi, Thomas Hofmann, Bernhard Schölkopf
Phenomenology of Double Descent in Finite-Width Neural Networks. ICLR (2022)
Lorenzo Noci, Sotiris Anagnostidis, Luca Biggio, Antonio Orvieto, Sidak Pal Singh, Aurélien Lucchi
Signal Propagation in Transformers: Theoretical Perspectives and the Role of Rank Collapse. CoRR (2022)
Lorenzo Noci, Sotiris Anagnostidis, Luca Biggio, Antonio Orvieto, Sidak Pal Singh, Aurélien Lucchi
Signal Propagation in Transformers: Theoretical Perspectives and the Role of Rank Collapse. NeurIPS (2022)
Sidak Pal Singh, Gregor Bachmann, Thomas Hofmann
Analytic Insights into Structure and Rank of Neural Network Hessian Maps. NeurIPS (2021)
Sidak Pal Singh, Gregor Bachmann, Thomas Hofmann
Analytic Insights into Structure and Rank of Neural Network Hessian Maps. CoRR (2021)
Sidak Pal Singh, Dan Alistarh
WoodFisher: Efficient Second-Order Approximation for Neural Network Compression. NeurIPS (2020)
Sidak Pal Singh, Andreas Hug, Aymeric Dieuleveut, Martin Jaggi
Context Mover's Distance & Barycenters: Optimal Transport of Contexts for Building Representations. AISTATS (2020)
Sidak Pal Singh, Dan Alistarh
WoodFisher: Efficient second-order approximations for model compression. CoRR (2020)
Sidak Pal Singh, Martin Jaggi
Model Fusion via Optimal Transport. NeurIPS (2020)
Sidak Pal Singh, Martin Jaggi
Model Fusion via Optimal Transport. CoRR (2019)
Sidak Pal Singh, Angela Fan, Michael Auli
GLOSS: Generative Latent Optimization of Sentence Representations. CoRR (2019)
Sidak Pal Singh, Andreas Hug, Aymeric Dieuleveut, Martin Jaggi
Context Mover's Distance & Barycenters: Optimal transport of contexts for building representations. DGS@ICLR (2019)
Sidak Pal Singh, Andreas Hug, Aymeric Dieuleveut, Martin Jaggi
Wasserstein is all you need. CoRR (2018)
Rohit Ranchal, Sidak Pal Singh, Pelin Angin, Ajay Mohindra, Hui Lei, Bharat K. Bhargava
RaaS and Hierarchical Aggregation Revisited. ICWS (2017)
Sidak Pal Singh, Sopan Khosla, Sajal Rustagi, Manisha Patel, Dhaval Patel
SL - FII: Syntactic and Lexical Constraints with Frequency based Iterative Improvement for Disease Mention Recognition in News Headlines. BAI@IJCAI (2016)