Soaring from 4K to 400K: Extending LLM's Context with Activation Beacon.

Peitian Zhang Zheng Liu Shitao Xiao Ninglu Shao Qiwei Ye Zhicheng Dou

Published in: CoRR (2024)

Keyphrases

contextual information
metadata
information processing
context sensitive
conceptual framework
neural network
machine learning
information retrieval
information systems
digital libraries
probabilistic model
context aware