NeuroPrune: A Neuro-inspired Topological Sparse Training Algorithm for Large Language Models.
Amit DhurandharTejaswini PedapatiRonny LussSoham DanAurélie C. LozanoPayel DasGeorgios KolliasPublished in: CoRR (2024)
Keyphrases
- language model
- training algorithm
- neural network
- back propagation
- language modeling
- n gram
- document retrieval
- probabilistic model
- artificial neural networks
- speech recognition
- retrieval model
- test collection
- language modelling
- training process
- information retrieval
- support vector machine
- query expansion
- learning rate
- rbf neural network
- high dimensional
- statistical language models
- document ranking
- hidden layer
- feed forward
- learning algorithm
- relevance model
- smoothing methods
- spoken term detection
- language models for information retrieval
- artificial intelligence
- decision trees
- training data
- data sets