Sequence Length is a Domain: Length-based Overfitting in Transformer Models.
Dusan VarisOndrej BojarPublished in: CoRR (2021)
Keyphrases
- fixed length
- domain models
- prior knowledge
- statistical models
- fuzzy logic
- machine learning
- total length
- conceptual models
- variable length
- mathematical models
- model selection
- probabilistic model
- domain specific
- parameter estimation
- computational models
- artificial neural networks
- training data
- image sequences
- information systems
- information retrieval
- data sets