Towards Green AI in Fine-tuning Large Language Models via Adaptive Backpropagation.
Kai HuangHanyun YinHeng HuangWei GaoPublished in: CoRR (2023)
Keyphrases
- language model
- fine tuning
- back propagation
- language modeling
- neural network
- artificial neural networks
- feed forward
- n gram
- training algorithm
- probabilistic model
- neural nets
- speech recognition
- bp algorithm
- information retrieval
- feed forward neural networks
- language modelling
- multilayer perceptron
- statistical language models
- feedforward neural networks
- hidden layer
- document retrieval
- artificial intelligence
- fine tuned
- backpropagation neural network
- retrieval model
- cascade correlation
- context sensitive
- smoothing methods
- learning algorithm
- backpropagation algorithm
- fuzzy logic
- expert systems
- bp neural network
- relevance model
- multilayer perceptron neural network
- query expansion
- language models for information retrieval
- translation model
- machine learning
- neural network ensemble
- backpropagation neural networks
- test collection
- multilayer neural network
- document ranking
- activation function
- statistical language modeling
- decision trees