How Well Can a Long Sequence Model Model Long Sequences? Comparing Architechtural Inductive Biases on Long-Context Abilities.

Published in: CoRR (2024)

Keyphrases

probabilistic model
statistical model
theoretical analysis
artificial neural networks
cost function
network model
neural network
computational model
prior knowledge
recommender systems
multi agent
reinforcement learning
case study
mathematical model
search engine
sensitivity analysis
formal model
genetic algorithm