LightFormer: Light-weight Transformer Using SVD-based Weight Transfer and Parameter Sharing.
Xiuqing LvPeng ZhangSunzhu LiGuobing GanYueheng SunPublished in: ACL (Findings) (2023)
Keyphrases
- lightweight
- knowledge sharing
- fuzzy logic
- information sharing
- fault diagnosis
- knowledge transfer
- wireless sensor networks
- data sharing
- parameter values
- weighting scheme
- singular value decomposition
- neural network
- cross domain
- transfer learning
- input parameters
- feature weights
- communication infrastructure
- parameter space
- multiple users
- partial discharge