Reusing Softmax Hardware Unit for GELU Computation in Transformers.
Christodoulos PeltekisKosmas AlexandridiGiorgos DimitrakopoulosPublished in: CoRR (2024)
Keyphrases
- low cost
- control unit
- hardware and software
- real time
- parallel computation
- processing units
- hardware architecture
- computer systems
- massively parallel
- vlsi implementation
- graphics hardware
- computing power
- genetic algorithm
- efficient computation
- database
- neural network
- learning objects
- general purpose
- video sequences
- digital circuits
- software implementation
- image processing
- e learning