Concept Formation and Alignment in Language Models: Bridging Statistical Patterns in Latent Space to Concept Taxonomy.
Mehrdad KhatirChandan K. ReddyPublished in: CoRR (2024)
Keyphrases
- concept formation
- language model
- language models for information retrieval
- latent space
- probabilistic model
- n gram
- latent variables
- information retrieval
- document retrieval
- query expansion
- retrieval model
- statistical language modeling
- machine learning
- test collection
- mixture model
- knowledge representation
- generative model
- dimensionality reduction
- parameter space
- gaussian process
- lower dimensional
- image classification
- co occurrence
- vector space model
- prior knowledge
- learning algorithm
- data mining