Characterizing Truthfulness in Large Language Model Generations with Local Intrinsic Dimension.
Fan YinJayanth SrinivasaKai-Wei ChangPublished in: CoRR (2024)
Keyphrases
- language model
- intrinsic dimension
- high dimensions
- language modeling
- intrinsic dimensionality
- dimension reduction
- diffusion maps
- high dimensional data
- n gram
- probabilistic model
- high dimensional
- nearest neighbor
- retrieval model
- information retrieval
- query expansion
- low dimensional
- dimensionality reduction
- context sensitive
- smoothing methods
- ad hoc information retrieval
- data distribution
- test collection
- similarity search
- mixture model
- sparse representation
- pattern recognition
- singular value decomposition
- semi supervised
- vector space
- graphical models
- data streams
- feature selection
- data mining