GIT-Mol: A Multi-modal Large Language Model for Molecular Science with Graph, Image, and Text.

Pengfei Liu Yiming Ren Zhixiang Ren

Published in: CoRR (2023)

Keyphrases

multi modal
language model
uni modal
multiple modalities
language modeling
information retrieval
video search
image content
multi modality
speech recognition
document retrieval
n gram
probabilistic model
image features
single modality
high dimensional
image retrieval
image representation
image classification
image collections
audio visual
web images
image segmentation
retrieval model
image regions
query expansion
mixture model
medical images
smoothing methods