SubGen: Token Generation in Sublinear Time and Memory.

Amir Zandieh Insu Han Vahab Mirrokni Amin Karbasi

Published in: CoRR (2024)

Keyphrases

memory requirements
memory usage
generation process
real world
computing power
low memory
information retrieval
computer vision
information systems
database systems
main memory
random access
memory size