Shapeshifter: a Parameter-efficient Transformer using Factorized Reshaped Matrices.

Aliakbar Panahi Seyran Saeedi Tom Arodz

Published in: NeurIPS (2021)

Keyphrases

lightweight
database
fault diagnosis
information retrieval
artificial intelligence
computationally expensive
singular value decomposition
matrix factorization