Word class representations spontaneously emerge in a deep neural network trained on next word prediction.
Kishore SurendraAchim SchillingPaul StoewerAndreas K. MaierPatrick KraussPublished in: CoRR (2023)
Keyphrases
- neural network
- prediction model
- co occurrence
- n gram
- elman network
- word recognition
- prediction accuracy
- multi layer perceptron
- related words
- word pairs
- neural network model
- artificial neural networks
- neural network is trained
- bp neural network
- auto associative
- trained neural network
- prediction algorithm
- multilayer perceptron
- training process
- document images
- fault diagnosis
- text classification
- information extraction
- training set
- keywords