The Impact of Quantization on Retrieval-Augmented Generation: An Analysis of Small LLMs.

Mert Yazan Suzan Verberne Frederik Situmeang

Published in: CoRR (2024)

Keyphrases

information retrieval
data analysis
image retrieval
image database
neural network
search engine
video sequences
image analysis
document retrieval
retrieval model