GIT-Mol: A multi-modal large language model for molecular science with graph, image, and text.
Pengfei LiuYiming RenJun TaoZhixiang RenPublished in: Comput. Biol. Medicine (2024)
Keyphrases
- multi modal
- language model
- multiple modalities
- information retrieval
- language modeling
- uni modal
- probabilistic model
- n gram
- speech recognition
- video search
- document retrieval
- image retrieval
- image features
- image classification
- image representation
- image segmentation
- image content
- query expansion
- image annotation
- high dimensional
- context sensitive
- image collections
- text mining
- test collection
- single modality
- multi modality
- machine learning
- low level
- audio visual
- query terms
- semantic information
- weighted graph
- keywords
- relevance model
- text retrieval
- retrieval model
- ad hoc information retrieval
- mixture model