Ali Ghodsi

ORCID

Publication Activity (10 Years)

Years Active: 2002-2024
Publications (10 Years): 89

Top Venues

Publications

Mahdi Karami, Ali Ghodsi
Orchid: Flexible and Data-Dependent Convolution for Sequence Modeling. CoRR (2024)
Parsa Kavehzadeh, Mojtaba Valipour, Marzieh S. Tahaei, Ali Ghodsi, Boxing Chen, Mehdi Rezagholizadeh
Sorted LLaMA: Unlocking the Potential of Intermediate Layers of Large Language Models for Dynamic Inference. EACL (Findings) (2024)
Ali Saheb Pasand, Reza Moravej, Mahdi Biparva, Raika Karimi, Ali Ghodsi
Scalable Graph Self-Supervised Learning. CoRR (2024)
Parsa Kavehzadeh, Mohammadreza Pourreza, Mojtaba Valipour, Tinashu Zhu, Haoli Bai, Ali Ghodsi, Boxing Chen, Mehdi Rezagholizadeh
S2D: Sorted Speculative Decoding For More Efficient Deployment of Nested Large Language Models. CoRR (2024)
Hossein Rajabzadeh, Mojtaba Valipour, Tianshu Zhu, Marzieh Tahaei, Hyock Ju Kwon, Ali Ghodsi, Boxing Chen, Mehdi Rezagholizadeh
QDyLoRA: Quantized Dynamic Low-Rank Adaptation for Efficient Large Language Model Tuning. CoRR (2024)
Ali Saheb Pasand, Reza Moravej, Mahdi Biparva, Ali Ghodsi
WERank: Towards Rank Degradation Prevention for Self-Supervised Learning Using Weight Regularization. CoRR (2024)
Lena Podina, Ali Ghodsi, Mohammad Kohandel
Learning Chemotherapy Drug Action via Universal Physics-Informed Neural Networks. CoRR (2024)
Mojtaba Valipour, Mehdi Rezagholizadeh, Ivan Kobyzev, Ali Ghodsi
DyLoRA: Parameter-Efficient Tuning of Pre-trained Models using Dynamic Search-Free Low-Rank Adaptation. EACL (2023)
Ivan Kobyzev, Aref Jafari, Mehdi Rezagholizadeh, Tianda Li, Alan Do-Omri, Peng Lu, Pascal Poupart, Ali Ghodsi
Do we need Label Regularization to Fine-tune Pre-trained Language Models? EACL (2023)
Benyamin Ghojogh, Ali Ghodsi
Recurrent Neural Networks and Long Short-Term Memory Networks: Tutorial and Survey. CoRR (2023)
Parsa Kavehzadeh, Mojtaba Valipour, Marzieh Tahaei, Ali Ghodsi, Boxing Chen, Mehdi Rezagholizadeh
Sorted LLaMA: Unlocking the Potential of Intermediate Layers of Large Language Models for Dynamic Inference Using Sorted Fine-Tuning (SoFT). CoRR (2023)
Mojtaba Valipour, Mehdi Rezagholizadeh, Hossein Rajabzadeh, Marzieh Tahaei, Boxing Chen, Ali Ghodsi
SortedNet, a Place for Every Network and Every Network in its Place: Towards a Generalized Solution for Training Many-in-One Neural Networks. CoRR (2023)
Aref Jafari, Mehdi Rezagholizadeh, Ali Ghodsi
Improved knowledge distillation by utilizing backward pass knowledge in neural networks. CoRR (2023)
Aref Jafari, Ivan Kobyzev, Mehdi Rezagholizadeh, Pascal Poupart, Ali Ghodsi
Continuation KD: Improved Knowledge Distillation through the Lens of Continuation Optimization. CoRR (2022)
Aref Jafari, Ivan Kobyzev, Mehdi Rezagholizadeh, Pascal Poupart, Ali Ghodsi
Continuation KD: Improved Knowledge Distillation through the Lens of Continuation Optimization. EMNLP (Findings) (2022)
Ehsan Kamalloo, Mehdi Rezagholizadeh, Ali Ghodsi
When Chosen Wisely, More Data Is What You Need: A Universal Sample-Efficient Strategy For Data Augmentation. CoRR (2022)
Mehdi Rezagholizadeh, Aref Jafari, Puneeth S. M. Saladi, Pranav Sharma, Ali Saheb Pasand, Ali Ghodsi
Pro-KD: Progressive Distillation by Following the Footsteps of the Teacher. COLING (2022)
Peng Lu, Ivan Kobyzev, Mehdi Rezagholizadeh, Ahmad Rashid, Ali Ghodsi, Philippe Langlais
Improving Generalization of Pre-trained Language Models via Stochastic Weight Averaging. EMNLP (Findings) (2022)
Mojtaba Valipour, Mehdi Rezagholizadeh, Ivan Kobyzev, Ali Ghodsi
DyLoRA: Parameter Efficient Tuning of Pre-trained Models using Dynamic Search-Free Low-Rank Adaptation. CoRR (2022)
Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley
Spectral, Probabilistic, and Deep Metric Learning: Tutorial and Survey. CoRR (2022)
Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley
Theoretical Connection between Locally Linear Embedding, Factor Analysis, and Probabilistic PCA. CoRR (2022)
Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley
Theoretical Connection between Locally Linear Embedding, Factor Analysis, and Probabilistic PCA. AI (2022)
Marzieh S. Tahaei, Ella Charlaix, Vahid Partovi Nia, Ali Ghodsi, Mehdi Rezagholizadeh
KroneckerBERT: Significant Compression of Pre-trained Language Models Through Kronecker Decomposition and Knowledge Distillation. NAACL-HLT (2022)
Ehsan Kamalloo, Mehdi Rezagholizadeh, Ali Ghodsi
When Chosen Wisely, More Data Is What You Need: A Universal Sample-Efficient Strategy For Data Augmentation. ACL (Findings) (2022)
Ivan Kobyzev, Aref Jafari, Mehdi Rezagholizadeh, Tianda Li, Alan Do-Omri, Peng Lu, Ali Ghodsi, Pascal Poupart
Towards Understanding Label Regularization for Fine-tuning Pre-trained Language Models. CoRR (2022)
Peng Lu, Ivan Kobyzev, Mehdi Rezagholizadeh, Ahmad Rashid, Ali Ghodsi, Philippe Langlais
Improving Generalization of Pre-trained Language Models via Stochastic Weight Averaging. CoRR (2022)
Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley
Unified Framework for Spectral Dimensionality Reduction, Maximum Variance Unfolding, and Kernel Learning By Semidefinite Programming: Tutorial and Survey. CoRR (2021)
Peng Lu, Abbas Ghaddar, Ahmad Rashid, Mehdi Rezagholizadeh, Ali Ghodsi, Philippe Langlais
RW-KD: Sample-wise Loss Terms Re-Weighting for Knowledge Distillation. EMNLP (Findings) (2021)
Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley
Generative Locally Linear Embedding. CoRR (2021)
Tianda Li, Ahmad Rashid, Aref Jafari, Pranav Sharma, Ali Ghodsi, Mehdi Rezagholizadeh
How to Select One Among All? An Extensive Empirical Study Towards the Robustness of Knowledge Distillation in Natural Language Understanding. CoRR (2021)
Ehsan Kamalloo, Mehdi Rezagholizadeh, Peyman Passban, Ali Ghodsi
Not Far Away, Not So Close: Sample Efficient Nearest Neighbour Data Augmentation via MiniMax. CoRR (2021)
Mojtaba Valipour, Bowen You, Maysum Panju, Ali Ghodsi
SymbolicGPT: A Generative Transformer Model for Symbolic Regression. CoRR (2021)
Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley
KKT Conditions, First-Order and Second-Order Optimization, and Distributed Optimization: Tutorial and Survey. CoRR (2021)
Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley
Laplacian-Based Dimensionality Reduction Including Spectral Clustering, Laplacian Eigenmap, Locality Preserving Projection, Graph Embedding, and Diffusion Map: Tutorial and Survey. CoRR (2021)
Mehdi Rezagholizadeh, Aref Jafari, Puneeth Salad, Pranav Sharma, Ali Saheb Pasand, Ali Ghodsi
Pro-KD: Progressive Distillation by Following the Footsteps of the Teacher. CoRR (2021)
Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley
Restricted Boltzmann Machine and Deep Belief Network: Tutorial and Survey. CoRR (2021)
Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley
Generative Adversarial Networks and Adversarial Autoencoders: Tutorial and Survey. CoRR (2021)
Hossein Rajabzadeh, Mansoor Zolghadri Jahromi, Ali Ghodsi
Supervised discriminative dimensionality reduction by learning multiple transformation operators. Expert Syst. Appl. 164 (2021)
Rui Qiao, Ngoc Hieu Tran, Lei Xin, Xin Chen, Ming Li, Baozhen Shan, Ali Ghodsi
Computationally instrument-resolution-independent de novo peptide sequencing for high-resolution devices. Nat. Mach. Intell. 3 (5) (2021)
K. Parand, Alireza Afzal Aghaei, Mostafa Jani, Ali Ghodsi
A new approach to the numerical solution of Fredholm integral equations using least squares-support vector regression. Math. Comput. Simul. 180 (2021)
Aref Jafari, Mehdi Rezagholizadeh, Pranav Sharma, Ali Ghodsi
Annealing Knowledge Distillation. EACL (2021)
Abtin Riasatian, Morteza Babaie, Danial Maleki, Shivam Kalra, Mojtaba Valipour, Sobhan Hemati, Manit Zaveri, Amir Safarpoor, Sobhan Shafiei, Mehdi Afshari, Maral Rasoolijaberi, Milad Sikaroudi, Mohd Adnan, Sultaan Shah, Charles Choi, Savvas Damaskinos, Clinton J. V. Campbell, Phedias Diamandis, Liron Pantanowitz, Hany Kashani, Ali Ghodsi, Hamid R. Tizhoosh
Fine-Tuning and training of densenet for histopathology image representation using TCGA diagnostic slides. Medical Image Anal. 70 (2021)
Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley
Sufficient Dimension Reduction for High-Dimensional Regression and Low-Dimensional Embedding: Tutorial and Survey. CoRR (2021)
Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley
Generative locally linear embedding: A module for manifold unfolding and visualization. Softw. Impacts 9 (2021)
Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley
Uniform Manifold Approximation and Projection (UMAP) and its Variants: Tutorial and Survey. CoRR (2021)
Shivendra Bhardwaj, Abbas Ghaddar, Ahmad Rashid, Khalil Bibi, Chengyang Li, Ali Ghodsi, Philippe Langlais, Mehdi Rezagholizadeh
Knowledge Distillation with Noisy Labels for Natural Language Understanding. CoRR (2021)
Sobhan Hemati, Shivam Kalra, Cameron Meaney, Morteza Babaie, Ali Ghodsi, Hamid R. Tizhoosh
CNN and Deep Sets for End-to-End Whole Slide Image Representation Learning. MIDL (2021)
Tianda Li, Ahmad Rashid, Aref Jafari, Pranav Sharma, Ali Ghodsi, Mehdi Rezagholizadeh
How to Select One Among All ? An Empirical Study Towards the Robustness of Knowledge Distillation in Natural Language Understanding. EMNLP (Findings) (2021)
Marzieh S. Tahaei, Ella Charlaix, Vahid Partovi Nia, Ali Ghodsi, Mehdi Rezagholizadeh
KroneckerBERT: Learning Kronecker Decomposition for Pre-trained Language Models via Knowledge Distillation. CoRR (2021)
Zeinab Hajimohammadi, Kourosh Parand, Ali Ghodsi
Legendre Deep Neural Network (LDNN) and its application for approximation of nonlinear Volterra Fredholm Hammerstein integral equations. CoRR (2021)
Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley
Johnson-Lindenstrauss Lemma, Linear and Nonlinear Random Projections, Random Fourier Features, and Random Kitchen Sinks: Tutorial and Survey. CoRR (2021)
Ehsan Kamalloo, Mehdi Rezagholizadeh, Peyman Passban, Ali Ghodsi
Not Far Away, Not So Close: Sample Efficient Nearest Neighbour Data Augmentation via MiniMax. ACL/IJCNLP (Findings) (2021)
Yimeng Wu, Mehdi Rezagholizadeh, Abbas Ghaddar, Md. Akmal Haidar, Ali Ghodsi
Universal-KD: Attention-based Output-Grounded Intermediate Layer Knowledge Distillation. EMNLP (1) (2021)
Aref Jafari, Mehdi Rezagholizadeh, Pranav Sharma, Ali Ghodsi
Annealing Knowledge Distillation. CoRR (2021)
Shivendra Bhardwaj, Abbas Ghaddar, Ahmad Rashid, Khalil Bibi, Chengyang Li, Ali Ghodsi, Philippe Langlais, Mehdi Rezagholizadeh
Knowledge Distillation with Noisy Labels for Natural Language Understanding. W-NUT (2021)
Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley
Factor Analysis, Probabilistic Principal Component Analysis, Variational Inference, and Variational Autoencoder: Tutorial and Survey. CoRR (2021)
Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley
Reproducing Kernel Hilbert Space, Mercer's Theorem, Eigenfunctions, Nyström Method, and Use of Kernels in Machine Learning: Tutorial and Survey. CoRR (2021)
Maysum Panju, Kourosh Parand, Ali Ghodsi
Symbolically Solving Partial Differential Equations using Deep Learning. CoRR (2020)
Maysum Panju, Ali Ghodsi
A Neuro-Symbolic Method for Solving Differential and Functional Equations. CoRR (2020)
Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley
Stochastic Neighbor Embedding with Gaussian and Student-t Distributions: Tutorial and Survey. CoRR (2020)
Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley
Multidimensional Scaling, Sammon Mapping, and Isomap: Tutorial and Survey. CoRR (2020)
Aref Jafari, Ali Ghodsi
Segmentation Approach for Coreference Resolution Task. CoRR (2020)
Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley
Locally Linear Embedding and its Variants: Tutorial and Survey. CoRR (2020)
Lida Abdi, Ali Ghodsi
Discriminant component analysis via distance correlation maximization. Pattern Recognit. 98 (2020)
Seyed Mahdi Rezaeinia, Rouhollah Rahmani, Ali Ghodsi, Hadi Veisi
Sentiment analysis based on improved pre-trained word embeddings. Expert Syst. Appl. 117 (2019)
Rui Qiao, Ngoc Hieu Tran, Ming Li, Lei Xin, Baozhen Shan, Ali Ghodsi
DeepNovoV2: Better de novo peptide sequencing with deep learning. CoRR (2019)
Amir-Hossein Karimi, Alexander Wong, Ali Ghodsi
SRP: Efficient class-aware embedding learning for large-scale data via supervised random projections. CoRR (2018)
Ershad Banijamali, Amir-Hossein Karimi, Ali Ghodsi
Deep Variational Sufficient Dimensionality Reduction. CoRR (2018)
Ershad Banijamali, Rui Shu, Mohammad Ghavamzadeh, Hung Hai Bui, Ali Ghodsi
Robust Locally-Linear Controllable Embedding. AISTATS (2018)
Seyed Mahdi Rezaeinia, Ali Ghodsi, Rouhollah Rahmani
Text Classification based on Multiple Block Convolutional Highways. CoRR (2018)
Rene Bidart, Mehrdad J. Gangeh, Mohammad Peikari, Sherine Salama, Sharon Nofech-Mozes, Anne L. Martel, Ali Ghodsi
Localization and classification of cell nuclei in post-neoadjuvant breast cancer surgical specimen using fully convolutional networks. Medical Imaging: Digital Pathology (2018)
Rick Wang, Amir-Hossein Karimi, Ali Ghodsi
Distance Correlation Autoencoder. IJCNN (2018)
Alaa El Khatib, Shimeng Huang, Ali Ghodsi, Fakhri Karray
Nonnegative Matrix Factorization Using Autoencoders And Exponentiated Gradient Descent. IJCNN (2018)
Mehrdad J. Gangeh, Hadi Zarkoob, Ali Ghodsi
Fast and Scalable Feature Selection for Gene Expression Data Using Hilbert-Schmidt Independence Criterion. IEEE ACM Trans. Comput. Biol. Bioinform. 14 (1) (2017)
Ershad Banijamali, Amir-Hossein Karimi, Alexander Wong, Ali Ghodsi
JADE: Joint Autoencoders for Dis-Entanglement. CoRR (2017)
Ershad Banijamali, Ali Ghodsi
Fast Spectral Clustering Using Autoencoders and Landmarks. ICIAR (2017)
Ershad Banijamali, Ali Ghodsi
Fast Spectral Clustering Using Autoencoders and Landmarks. CoRR (2017)
Amir-Hossein Karimi, M. J. Shafiee, Ali Ghodsi, Alexander Wong
Synthesizing Deep Neural Network Architectures using Biological Synaptic Strength Distributions. CoRR (2017)
Sara Sharifzadeh, Ali Ghodsi, Line H. Clemmensen, Bjarne K. Ersbøll
Sparse supervised principal component analysis (SSPCA) for dimension reduction and variable selection. Eng. Appl. Artif. Intell. 65 (2017)
Ershad Banijamali, Ali Ghodsi, Pascal Poupart
Generative Mixture of Networks. CoRR (2017)
Amir-Hossein Karimi, Audrey G. Chung, Mohammad Javad Shafiee, Farzad Khalvati, Masoom A. Haider, Ali Ghodsi, Alexander Wong
Discovery Radiomics via a Mixture of Deep ConvNet Sequencers for Multi-parametric MRI Prostate Cancer Classification. ICIAR (2017)
Ershad Banijamali, Rui Shu, Mohammad Ghavamzadeh, Hung Hai Bui, Ali Ghodsi
Robust Locally-Linear Controllable Embedding. CoRR (2017)
Ershad Banijamali, Ahmad Khajenezhad, Ali Ghodsi, Mohammad Ghavamzadeh
Disentangling Dynamics and Content for Control and Planning. CoRR (2017)
Ershad Banijamali, Ali Ghodsi, Pascal Poupart
Generative mixture of networks. IJCNN (2017)
Shima Kamyab, Ali Ghodsi, Zohreh Azimifar
Deep Structure for end-to-end inverse rendering. CoRR (2017)
Seyed Mahdi Rezaeinia, Ali Ghodsi, Rouhollah Rahmani
Improving the Accuracy of Pre-trained Word Embeddings for Sentiment Analysis. CoRR (2017)
Mehrdad J. Gangeh, Safaa M. A. Bedawi, Ali Ghodsi, Fakhri Karray
Semi-supervised Dictionary Learning Based on Hilbert-Schmidt Independence Criterion. ICIAR (2016)
Mehrdad J. Gangeh, Safaa M. A. Bedawi, Ali Ghodsi, Fakhri Karray
Semi-supervised Dictionary Learning Based on Hilbert-Schmidt Independence Criterion. CoRR (2016)
Ershad Banijamali, Ali Ghodsi
Semi-Supervised Representation Learning based on Probabilistic Labeling. CoRR (2016)
Ge Yang, Ali Ghodsi
Kolmogorov complexity vector: A novel data representation. IJCNN (2015)
Ahmed K. Farahat, Ahmed Elgohary, Ali Ghodsi, Mohamed S. Kamel
Greedy column subset selection for large-scale data sets. Knowl. Inf. Syst. 45 (1) (2015)
Hassan Ashtiani, Ali Ghodsi
A Dimension-Independent Generalization Bound for Kernel Supervised Principal Component Analysis. FE@NIPS (2015)
Tameem Adel, David Balduzzi, Ali Ghodsi
Learning the Structure of Sum-Product Networks via an SVD-based Algorithm. UAI (2015)
Mehrdad J. Gangeh, Ahmed K. Farahat, Ali Ghodsi, Mohamed S. Kamel
Supervised Dictionary Learning and Sparse Representation-A Review. CoRR (2015)
Fatemeh Dorri, Ali Ghodsi
Minimizing the Discrepancy Between Source and Target Domains by Learning Adapting Components. J. Comput. Sci. Technol. 29 (1) (2014)
Mehrdad J. Gangeh, Pouria Fewzee, Ali Ghodsi, Mohamed S. Kamel, Fakhri Karray
Multiview Supervised Dictionary Learning in Speech Emotion Recognition. IEEE ACM Trans. Audio Speech Lang. Process. 22 (6) (2014)
Ahmed K. Farahat, Ali Ghodsi, Mohamed S. Kamel
Efficient greedy feature selection for unsupervised learning. Knowl. Inf. Syst. 35 (2) (2013)
Ali-Akbar Samadani, Ali Ghodsi, Dana Kulic
Discriminative functional analysis of human movements. Pattern Recognit. Lett. 34 (15) (2013)
Babak Alipanahi, Nathan Krislock, Ali Ghodsi, Henry Wolkowicz, Logan Donaldson, Ming Li
Determining Protein Structures from NOESY Distance Constraints by Semidefinite Programming. J. Comput. Biol. 20 (4) (2013)
Ahmed K. Farahat, Ahmed Elgohary, Ali Ghodsi, Mohamed S. Kamel
Greedy Column Subset Selection for Large-scale Data Sets. CoRR (2013)

Ali Ghodsi.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

Ali Ghodsi