Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark.
Yihua ZhangPingzhi LiJunyuan HongJiaxiang LiYimeng ZhangWenqing ZhengPin-Yu ChenJason D. LeeWotao YinMingyi HongZhangyang WangSijia LiuTianlong ChenPublished in: CoRR (2024)