NeuroPrune: A Neuro-inspired Topological Sparse Training Algorithm for Large Language Models.
Amit DhurandharTejaswini PedapatiRonny LussSoham DanAurélie C. LozanoPayel DasGeorgios KolliasPublished in: ACL (Findings) (2024)
Keyphrases
- training algorithm
- language model
- neural network
- language modeling
- back propagation
- n gram
- document retrieval
- artificial neural networks
- speech recognition
- retrieval model
- probabilistic model
- support vector machine
- information retrieval
- query expansion
- statistical language models
- training process
- feed forward
- test collection
- language modelling
- learning rate
- language models for information retrieval
- data sets
- document ranking
- high dimensional
- hidden layer
- rbf neural network
- neural network model
- learning algorithm
- genetic algorithm
- neural nets
- pattern recognition
- smoothing methods
- pairwise
- co occurrence
- support vector