Analyzing the Scaling Characteristics of Transformer Feed-Forward Networks for the Trillion-Parameter Era and Beyond.

Taehyun Kim Hyuk-Jae Lee

Published in: ICEIC (2024)

Keyphrases

fuzzy logic
artificial intelligence
fault diagnosis
parameter settings
three dimensional
image sequences
information technology
similarity measure
distribution network
input parameters
parameter space
high dimensional
real time
metadata
decision making
machine learning
neural network