Investigating semantic subspaces of Transformer sentence embeddings through linear structural probing.
Dmitry NikolaevSebastian PadóPublished in: CoRR (2023)
Keyphrases
- hilbert space
- natural language
- low dimensional
- dependency relations
- high dimensional data
- semantic information
- recognizing textual entailment
- grassmann manifold
- semantic roles
- infinite dimensional
- structural information
- semantic content
- semantic network
- high level
- finite dimensional
- semantic similarity
- sentence similarity
- semantic web
- metadata
- information extraction
- text representation
- fuzzy logic
- semantic representation
- nearest neighbor
- dimensionality reduction
- natural language sentences
- syntactic structures
- principal component analysis
- question answering
- distance measure
- structural features
- conceptual graphs
- semantic features
- semantic analysis
- data points
- context dependent
- wordnet