Tiny Attention: A Simple yet Effective Method for Learning Contextual Word Embeddings.
Renjith P. RavindranNarayana Murthy KaviPublished in: Tiny Papers @ ICLR (2023)
Keyphrases
- learning algorithm
- prior knowledge
- high accuracy
- high precision
- learning process
- cost function
- probabilistic model
- active learning
- detection method
- image segmentation
- segmentation method
- significant improvement
- computational cost
- contextual information
- genetic algorithm
- machine learning
- learning tasks
- learning scheme
- unsupervised learning
- natural language processing
- supervised learning
- dynamic programming
- pairwise
- computational complexity
- reinforcement learning
- feature extraction