Understanding Token Probability Encoding in Output Embeddings.

Hakaze Cho Yoshihiro Sakai Kenshiro Tanaka Mariko Kato Naoya Inoue

Published in: CoRR (2024)

Keyphrases

probability distribution
encoding scheme
high dimensional
probability values
expert systems
multiresolution
input data
euclidean space
variable length
state transition