Reusing Softmax Hardware Unit for GELU Computation in Transformers.

Christodoulos Peltekis Kosmas Alexandridis Giorgos Dimitrakopoulos

Published in: AICAS (2024)

Keyphrases

control unit
real time
processing units
hardware and software
low cost
computer systems
parallel computation
control system
image processing
data sets
learning objects
video sequences
hardware implementation
computing systems
computing power
power supply
temporal difference learning