Sihwa Lee

Publication Activity (10 Years)

Years Active: 2021-2024
Publications (10 Years): 7

Top Topics

Language Modelling

Top Venues

Publications

Minsoo Kim, Sihwa Lee, Wonyong Sung, Jungwook Choi
RA-LoRA: Rank-Adaptive Parameter-Efficient Fine-Tuning for Accurate 2-bit Quantized Large Language Models. ACL (Findings) (2024)
Minsoo Kim, Sihwa Lee, Janghwan Lee, Sukjin Hong, Du-Seong Chang, Wonyong Sung, Jungwook Choi
Token-Scaled Logit Distillation for Ternary Weight Generative Language Models. CoRR (2023)
Minsoo Kim, Sihwa Lee, Janghwan Lee, Sukjin Hong, Du-Seong Chang, Wonyong Sung, Jungwook Choi
Token-Scaled Logit Distillation for Ternary Weight Generative Language Models. NeurIPS (2023)
Joonsang Yu, Junki Park, Seongmin Park, Minsoo Kim, Sihwa Lee, Dong Hyun Lee, Jungwook Choi
NN-LUT: neural approximation of non-linear operations for efficient transformer inference. DAC (2022)
Minsoo Kim, Sihwa Lee, Sukjin Hong, Du-Seong Chang, Jungwook Choi
Understanding and Improving Knowledge Distillation for Quantization Aware Training of Large Transformer Encoders. EMNLP (2022)
Minsoo Kim, Sihwa Lee, Sukjin Hong, Du-Seong Chang, Jungwook Choi
Understanding and Improving Knowledge Distillation for Quantization-Aware Training of Large Transformer Encoders. CoRR (2022)
Joonsang Yu, Junki Park, Seongmin Park, Minsoo Kim, Sihwa Lee, Dong Hyun Lee, Jungwook Choi
NN-LUT: Neural Approximation of Non-Linear Operations for Efficient Transformer Inference. CoRR (2021)