HiFi: High-Information Attention Heads Hold for Parameter-Efficient Model Adaptation.

Anchun Gui Han Xiao

Published in: ACL (1) (2023)

Keyphrases

keywords
domain knowledge
information sources
information extraction
information fusion
data sets
prior knowledge
higher level
information processing
contextual information
cost effective
web content
information flow