Towards Green AI in Fine-tuning Large Language Models via Adaptive Backpropagation.
Kai HuangHanyun YinHeng HuangWei GaoPublished in: ICLR (2024)
Keyphrases
- language model
- fine tuning
- back propagation
- neural network
- language modeling
- feed forward
- artificial neural networks
- n gram
- probabilistic model
- feed forward neural networks
- artificial intelligence
- document retrieval
- training algorithm
- hidden layer
- feedforward neural networks
- bp neural network
- multilayer perceptron
- query expansion
- neural nets
- language modelling
- speech recognition
- fuzzy logic
- bp algorithm
- information retrieval
- learning algorithm
- statistical language models
- multilayer perceptron neural network
- backpropagation neural network
- fine tuned
- retrieval model
- test collection
- neural network ensemble
- smoothing methods
- activation function
- backpropagation neural networks
- language models for information retrieval
- relevance model
- machine learning
- backpropagation algorithm
- context sensitive
- expert systems
- statistical language modeling