A Study on How Attention Scores in the BERT Model are Aware of Lexical Categories in Syntactic and Semantic Tasks on the GLUE Benchmark.
Dongjun JangSungjoo ByunHyopil ShinPublished in: CoRR (2024)
Keyphrases
- study proposes
- high level
- objective function
- probabilistic model
- domain specific
- knowledge base
- similarity measure
- mathematical model
- simulation study
- syntactic semantic
- neural network
- recognizing textual entailment
- semantic models
- context dependent
- hierarchical structure
- semantic web
- natural language
- information retrieval
- machine learning