Syntactic Perturbations Reveal Representational Correlates of Hierarchical Phrase Structure in Pretrained Language Models.
Matteo AllemanJonathan MamouMiguel A. Del RioHanlin TangYoon KimSueYeon ChungPublished in: RepL4NLP@ACL-IJCNLP (2021)
Keyphrases
- language model
- phrase structure
- dependency structure
- language modeling
- n gram
- context free
- context sensitive
- probabilistic model
- document retrieval
- part of speech
- retrieval model
- information retrieval
- tree structures
- test collection
- query expansion
- query terms
- vector space model
- pseudo relevance feedback
- cross lingual
- natural language
- word order
- feature selection