Yikang Shen

Publication Activity (10 Years)

Years Active: 2014-2024
Publications (10 Years): 89

Top Topics

Diffusion Models

Top Venues

Publications

Zhen Guo, Adriana Meza Soria, Wei Sun, Yikang Shen, Rameswar Panda
API Pack: A Massive Multilingual Dataset for API Call Generation. CoRR (2024)
Zhiqing Sun, Longhui Yu, Yikang Shen, Weiyang Liu, Yiming Yang, Sean Welleck, Chuang Gan
Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision. CoRR (2024)
Zhenfang Chen, Qinhong Zhou, Yikang Shen, Yining Hong, Zhiqing Sun, Dan Gutfreund, Chuang Gan
Visual Chain-of-Thought Prompting for Knowledge-Based Visual Reasoning. AAAI (2024)
Wenyu Du, Tongxu Luo, Zihan Qiu, Zeyu Huang, Yikang Shen, Reynold Cheng, Yike Guo, Jie Fu
Stacking Your Transformers: A Closer Look at Model Growth for Efficient LLM Pre-Training. CoRR (2024)
Zhiqing Sun, Yikang Shen, Hongxin Zhang, Qinhong Zhou, Zhenfang Chen, David Daniel Cox, Yiming Yang, Chuang Gan
SALMON: Self-Alignment with Instructable Reward Models. ICLR (2024)
Matt Stallone, Vaibhav Saxena, Leonid Karlinsky, Bridget McGinn, Tim Bula, Mayank Mishra, Adriana Meza Soria, Gaoyuan Zhang, Aditya Prasad, Yikang Shen, Saptha Surendran, Shanmukha C. Guttula, Hima Patel, Parameswaran Selvam, Xuan-Hong Dang, Yan Koyfman, Atin Sood, Rogério Feris, Nirmit Desai, David D. Cox, Ruchir Puri, Rameswar Panda
Scaling Granite Code Models to 128K Context. CoRR (2024)
Junyan Li, Delin Chen, Yining Hong, Zhenfang Chen, Peihao Chen, Yikang Shen, Chuang Gan
CoVLM: Composing Visual Entities and Relationships in Large Language Models Via Communicative Decoding. ICLR (2024)
Mayank Mishra, Matt Stallone, Gaoyuan Zhang, Yikang Shen, Aditya Prasad, Adriana Meza Soria, Michele Merler, Parameswaran Selvam, Saptha Surendran, Shivdeep Singh, Manish Sethi, Xuan-Hong Dang, Pengyuan Li, Kun-Lung Wu, Syed Zawad, Andrew Coleman, Matthew White, Mark Lewis, Raju Pavuluri, Yan Koyfman, Boris Lublinsky, Maximilien de Bayser, Ibrahim Abdelaziz, Kinjal Basu, Mayank Agarwal, Yi Zhou, Chris Johnson, Aanchal Goyal, Hima Patel, S. Yousaf Shah, Petros Zerfos, Heiko Ludwig, Asim Munawar, Maxwell Crouse, Pavan Kapanipathi, Shweta Salaria, Bob Calio, Sophia Wen, Seetharami Seelam, Brian Belgodere, Carlos A. Fonseca, Amith Singhee, Nirmit Desai, David D. Cox, Ruchir Puri, Rameswar Panda
Granite Code Models: A Family of Open Foundation Models for Code Intelligence. CoRR (2024)
Yikang Shen, Zhen Guo, Tianle Cai, Zengyi Qin
JetMoE: Reaching Llama2 Performance with 0.1M Dollars. CoRR (2024)
Songlin Yang, Bailin Wang, Yu Zhang, Yikang Shen, Yoon Kim
Parallelizing Linear Transformers with the Delta Rule over Sequence Length. CoRR (2024)
Zhiqing Sun, Sheng Shen, Shengcao Cao, Haotian Liu, Chunyuan Li, Yikang Shen, Chuang Gan, Liangyan Gui, Yu-Xiong Wang, Yiming Yang, Kurt Keutzer, Trevor Darrell
Aligning Large Multimodal Models with Factually Augmented RLHF. ACL (Findings) (2024)
Athul Paul Jacob, Yikang Shen, Gabriele Farina, Jacob Andreas
The Consensus Game: Language Model Generation via Equilibrium Search. ICLR (2024)
Shun Zhang, Zhenfang Chen, Sunli Chen, Yikang Shen, Zhiqing Sun, Chuang Gan
Improving Reinforcement Learning from Human Feedback with Efficient Reward Model Ensemble. CoRR (2024)
Shawn Tan, Yikang Shen, Rameswar Panda, Aaron C. Courville
Scattered Mixture-of-Experts Implementation. CoRR (2024)
Yiduo Guo, Jie Fu, Huishuai Zhang, Dongyan Zhao, Yikang Shen
Efficient Continual Pre-training by Mitigating the Stability Gap. CoRR (2024)
Talia Gershon, Seetharami Seelam, Brian Belgodere, Milton Bonilla, Lan Hoang, Danny Barnett, I-Hsin Chung, Apoorve Mohan, Ming-Hung Chen, Lixiang Luo, Robert Walkup, Constantinos Evangelinos, Shweta Salaria, Marc Dombrowa, Yoonho Park, Apo Kayi, Liran Schour, Alim Alim, Ali Sydney, Pavlos Maniotis, Laurent Schares, Bernard Metzler, Bengi Karacali-Akyamac, Sophia Wen, Tatsuhiro Chiba, Sunyanan Choochotkaew, Takeshi Yoshimura, Claudia Misale, Tonia Elengikal, Kevin O. Connor, Zhuoran Liu, Richard Molina, Lars Schneidenbach, James Caden, Christopher Laibinis, Carlos Fonseca, Vasily Tarasov, Swaminathan Sundararaman, Frank B. Schmuck, Scott Guthridge, Jeremy Cohn, Marc Eshel, Paul Muench, Runyu Liu, William Pointer, Drew Wyskida, Bob Krull, Ray Rose, Brent Wolfe, William Cornejo, John Walter, Colm Malone, Clifford Perucci, Frank Franco, Nigel Hinds, Bob Calio, Pavel Druyan, Robert Kilduff, John Kienle, Connor McStay, Andrew Figueroa, Matthew Connolly, Edie Fost, Gina Roma, Jake Fonseca, Ido Levy, Michele Payne, Ryan Schenkel, Amir Malki, Lion Schneider, Aniruddha Narkhede, Shekeba Moshref, Alexandra Kisin, Olga Dodin, Bill Rippon, Henry Wrieth, John Ganci, Johnny Colino, Donna Habeger-Rose, Rakesh Pandey, Aditya Gidh, Aditya Gaur, Dennis Patterson, Samsuddin Salmani, Rambilas Varma, Rumana Rumana, Shubham Sharma, Mayank Mishra, Rameswar Panda, Aditya Prasad, Matt Stallone, Gaoyuan Zhang, Yikang Shen, David Cox, Ruchir Puri, Dakshi Agrawal, Drew Thorstensen, Joel Belog, Brent Tang
The infrastructure powering IBM's Gen AI model development. CoRR (2024)
Wei Chen, Zhiyuan Li, Zhen Guo, Yikang Shen
Octo-planner: On-device Language Model for Planner-Action Agents. CoRR (2024)
Junyan Li, Delin Chen, Tianle Cai, Peihao Chen, Yining Hong, Zhenfang Chen, Yikang Shen, Chuang Gan
FlexAttention for Efficient High-Resolution Vision-Language Models. CoRR (2024)
Mayank Agarwal, Yikang Shen, Bailin Wang, Yoon Kim, Jie Chen
Structured Code Representations Enable Data-Efficient Adaptation of Code Language Models. CoRR (2024)
Peiqi Wang, Yikang Shen, Zhen Guo, Matthew Stallone, Yoon Kim, Polina Golland, Rameswar Panda
Diversity Measurement and Subset Selection for Instruction Tuning Datasets. CoRR (2024)
Bowen Pan, Yikang Shen, Haokun Liu, Mayank Mishra, Gaoyuan Zhang, Aude Oliva, Colin Raffel, Rameswar Panda
Dense Training, Sparse Inference: Rethinking Training of Mixture-of-Experts Language Models. CoRR (2024)
Shawn Tan, Yikang Shen, Zhenfang Chen, Aaron C. Courville, Chuang Gan
Sparse Universal Transformer. CoRR (2023)
Zheyu Zhang, Zhuorui Ye, Yikang Shen, Chuang Gan
Autonomous Tree-search Ability of Large Language Models. CoRR (2023)
Songlin Yang, Bailin Wang, Yikang Shen, Rameswar Panda, Yoon Kim
Gated Linear Attention Transformers with Hardware-Efficient Training. CoRR (2023)
Zitian Chen, Mingyu Ding, Yikang Shen, Wei Zhan, Masayoshi Tomizuka, Erik G. Learned-Miller, Chuang Gan
An Efficient General-Purpose Modular Vision Model via Multi-Task Heterogeneous Training. CoRR (2023)
Shun Zhang, Zhenfang Chen, Yikang Shen, Mingyu Ding, Joshua B. Tenenbaum, Chuang Gan
Planning with Large Language Models for Code Generation. ICLR (2023)
Shun Zhang, Zhenfang Chen, Yikang Shen, Mingyu Ding, Joshua B. Tenenbaum, Chuang Gan
Planning with Large Language Models for Code Generation. CoRR (2023)
Zhiqing Sun, Yikang Shen, Qinhong Zhou, Hongxin Zhang, Zhenfang Chen, David D. Cox, Yiming Yang, Chuang Gan
Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human Supervision. NeurIPS (2023)
Shawn Tan, Yikang Shen, Zhenfang Chen, Aaron C. Courville, Chuang Gan
Sparse Universal Transformer. EMNLP (2023)
Zhiqing Sun, Yikang Shen, Qinhong Zhou, Hongxin Zhang, Zhenfang Chen, David D. Cox, Yiming Yang, Chuang Gan
Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human Supervision. CoRR (2023)
Jianan Zhao, Le Zhuo, Yikang Shen, Meng Qu, Kai Liu, Michael M. Bronstein, Zhaocheng Zhu, Jian Tang
GraphText: Graph Reasoning in Text Space. CoRR (2023)
Junyan Li, Delin Chen, Yining Hong, Zhenfang Chen, Peihao Chen, Yikang Shen, Chuang Gan
CoVLM: Composing Visual Entities and Relationships in Large Language Models Via Communicative Decoding. CoRR (2023)
Chengyang Zhao, Yikang Shen, Zhenfang Chen, Mingyu Ding, Chuang Gan
TextPSG: Panoptic Scene Graph Generation from Textual Descriptions. ICCV (2023)
Zhenfang Chen, Qinhong Zhou, Yikang Shen, Yining Hong, Hao Zhang, Chuang Gan
See, Think, Confirm: Interactive Prompting Between Vision and Language Models for Knowledge-based Visual Reasoning. CoRR (2023)
Athul Paul Jacob, Yikang Shen, Gabriele Farina, Jacob Andreas
The Consensus Game: Language Model Generation via Equilibrium Search. CoRR (2023)
Yikang Shen, Zheyu Zhang, Tianyou Cao, Shawn Tan, Zhenfang Chen, Chuang Gan
ModuleFormer: Learning Modular Large Language Models From Uncurated Data. CoRR (2023)
Zhiqing Sun, Sheng Shen, Shengcao Cao, Haotian Liu, Chunyuan Li, Yikang Shen, Chuang Gan, Liang-Yan Gui, Yu-Xiong Wang, Yiming Yang, Kurt Keutzer, Trevor Darrell
Aligning Large Multimodal Models with Factually Augmented RLHF. CoRR (2023)
Chengyang Zhao, Yikang Shen, Zhenfang Chen, Mingyu Ding, Chuang Gan
TextPSG: Panoptic Scene Graph Generation from Textual Descriptions. CoRR (2023)
Zitian Chen, Yikang Shen, Mingyu Ding, Zhenfang Chen, Hengshuang Zhao, Erik G. Learned-Miller, Chuang Gan
Mod-Squad: Designing Mixtures of Experts As Modular Multi-Task Learners. CVPR (2023)
Siyuan Zhou, Yilun Du, Shun Zhang, Mengdi Xu, Yikang Shen, Wei Xiao, Dit-Yan Yeung, Chuang Gan
Adaptive Online Replanning with Diffusion Models. CoRR (2023)
Zeyu Huang, Yikang Shen, Xiaofeng Zhang, Jie Zhou, Wenge Rong, Zhang Xiong
Transformer-Patcher: One Mistake Worth One Neuron. ICLR (2023)
Zhiqing Sun, Yikang Shen, Hongxin Zhang, Qinhong Zhou, Zhenfang Chen, David D. Cox, Yiming Yang, Chuang Gan
SALMON: Self-Alignment with Principle-Following Reward Models. CoRR (2023)
Mingyu Ding, Yikang Shen, Lijie Fan, Zhenfang Chen, Zitian Chen, Ping Luo, Joshua B. Tenenbaum, Chuang Gan
Visual Dependency Transformers: Dependency Tree Emerges from Reversed Attention. CVPR (2023)
Siyuan Zhou, Yilun Du, Shun Zhang, Mengdi Xu, Yikang Shen, Wei Xiao, Dit-Yan Yeung, Chuang Gan
Adaptive Online Replanning with Diffusion Models. NeurIPS (2023)
Zeyu Huang, Yikang Shen, Xiaofeng Zhang, Jie Zhou, Wenge Rong, Zhang Xiong
Transformer-Patcher: One Mistake worth One Neuron. CoRR (2023)
Mengdi Xu, Yuchen Lu, Yikang Shen, Shun Zhang, Ding Zhao, Chuang Gan
Hyper-Decision Transformer for Efficient Online Policy Adaptation. ICLR (2023)
Mengdi Xu, Yuchen Lu, Yikang Shen, Shun Zhang, Ding Zhao, Chuang Gan
Hyper-Decision Transformer for Efficient Online Policy Adaptation. CoRR (2023)
Mingyu Ding, Yikang Shen, Lijie Fan, Zhenfang Chen, Zitian Chen, Ping Luo, Joshua B. Tenenbaum, Chuang Gan
Visual Dependency Transformers: Dependency Tree Emerges from Reversed Attention. CoRR (2023)
Yikang Shen, Shawn Tan, Alessandro Sordoni, Peng Li, Jie Zhou, Aaron C. Courville
Unsupervised Dependency Graph Network. ACL (1) (2022)
Xiaotao Gu, Yikang Shen, Jiaming Shen, Jingbo Shang, Jiawei Han
Phrase-aware Unsupervised Constituency Parsing. ACL (1) (2022)
Mengdi Xu, Yikang Shen, Shun Zhang, Yuchen Lu, Ding Zhao, Joshua B. Tenenbaum, Chuang Gan
Prompting Decision Transformer for Few-Shot Policy Generalization. CoRR (2022)
Yikang Shen
Syntactic Inductive Biases for Deep Learning Methods. CoRR (2022)
Xiaofeng Zhang, Yikang Shen, Zeyu Huang, Jie Zhou, Wenge Rong, Zhang Xiong
Mixture of Attention Heads: Selecting Attention Heads Per Token. EMNLP (2022)
Zitian Chen, Yikang Shen, Mingyu Ding, Zhenfang Chen, Hengshuang Zhao, Erik G. Learned-Miller, Chuang Gan
Mod-Squad: Designing Mixture of Experts As Modular Multi-Task Learners. CoRR (2022)
Xiaofeng Zhang, Yikang Shen, Zeyu Huang, Jie Zhou, Wenge Rong, Zhang Xiong
Mixture of Attention Heads: Selecting Attention Heads Per Token. CoRR (2022)
Mengdi Xu, Yikang Shen, Shun Zhang, Yuchen Lu, Ding Zhao, Joshua B. Tenenbaum, Chuang Gan
Prompting Decision Transformer for Few-Shot Policy Generalization. ICML (2022)
Yuchen Lu, Yikang Shen, Siyuan Zhou, Aaron C. Courville, Joshua B. Tenenbaum, Chuang Gan
Learning Task Decomposition with Ordered Memory Policy Network. ICLR (2021)
Yikang Shen, Yi Tay, Che Zheng, Dara Bahri, Donald Metzler, Aaron C. Courville
StructFormer: Joint Unsupervised Induction of Dependency and Constituency Structure from Masked Language Modeling. ACL/IJCNLP (1) (2021)
Aston Zhang, Yi Tay, Yikang Shen, Alvin Chan, Shuai Zhang
Self-Instantiated Recurrent Units with Dynamic Soft Recursion. NeurIPS (2021)
Yikang Shen, Shawn Tan, Alessandro Sordoni, Siva Reddy, Aaron C. Courville
Explicitly Modeling Syntax in Language Models with Incremental Parsing and a Dynamic Oracle. NAACL-HLT (2021)
Yi Tay, Mostafa Dehghani, Samira Abnar, Yikang Shen, Dara Bahri, Philip Pham, Jinfeng Rao, Liu Yang, Sebastian Ruder, Donald Metzler
Long Range Arena : A Benchmark for Efficient Transformers. ICLR (2021)
Yuchen Lu, Yikang Shen, Siyuan Zhou, Aaron C. Courville, Joshua B. Tenenbaum, Chuang Gan
Learning Task Decomposition with Ordered Memory Policy Network. CoRR (2021)
Shawn Tan, Yikang Shen, Alessandro Sordoni, Aaron C. Courville, Timothy J. O'Donnell
Recursive Top-Down Production for Sentence Generation with Latent Trees. EMNLP (Findings) (2020)
Shawn Tan, Yikang Shen, Timothy J. O'Donnell, Alessandro Sordoni, Aaron C. Courville
Recursive Top-Down Production for Sentence Generation with Latent Trees. CoRR (2020)
Yikang Shen, Yi Tay, Che Zheng, Dara Bahri, Donald Metzler, Aaron C. Courville
StructFormer: Joint Unsupervised Induction of Dependency and Constituency Structure from Masked Language Modeling. CoRR (2020)
Yikang Shen, Shawn Tan, Alessandro Sordoni, Siva Reddy, Aaron C. Courville
Explicitly Modeling Syntax in Language Model improves Generalization. CoRR (2020)
Yi Tay, Mostafa Dehghani, Samira Abnar, Yikang Shen, Dara Bahri, Philip Pham, Jinfeng Rao, Liu Yang, Sebastian Ruder, Donald Metzler
Long Range Arena: A Benchmark for Efficient Transformers. CoRR (2020)
Wenyu Du, Zhouhan Lin, Yikang Shen, Timothy J. O'Donnell, Yoshua Bengio, Yue Zhang
Exploiting Syntactic Structure for Better Language Modeling: A Syntactic Distance Approach. ACL (2020)
Wenyu Du, Zhouhan Lin, Yikang Shen, Timothy J. O'Donnell, Yoshua Bengio, Yue Zhang
Exploiting Syntactic Structure for Better Language Modeling: A Syntactic Distance Approach. CoRR (2020)
Shawn Tan, Yikang Shen, Chin-Wei Huang, Aaron C. Courville
Investigating Biases in Textual Entailment Datasets. CoRR (2019)
Yikang Shen, Shawn Tan, Seyed Arian Hosseini, Zhouhan Lin, Alessandro Sordoni, Aaron C. Courville
Ordered Memory. NeurIPS (2019)
Yikang Shen, Shawn Tan, Alessandro Sordoni, Aaron C. Courville
Ordered Neurons: Integrating Tree Structures into Recurrent Neural Networks. ICLR (2019)
Yikang Shen, Shawn Tan, Seyedarian Hosseini, Zhouhan Lin, Alessandro Sordoni, Aaron C. Courville
Ordered Memory. CoRR (2019)
Yikang Shen, Zhouhan Lin, Athul Paul Jacob, Alessandro Sordoni, Aaron C. Courville, Yoshua Bengio
Straight to the Tree: Constituency Parsing with Neural Syntactic Distance. ACL (1) (2018)
Yikang Shen, Zhouhan Lin, Athul Paul Jacob, Alessandro Sordoni, Aaron C. Courville, Yoshua Bengio
Straight to the Tree: Constituency Parsing with Neural Syntactic Distance. CoRR (2018)
Yikang Shen, Zhouhan Lin, Chin-Wei Huang, Aaron C. Courville
Neural Language Modeling by Jointly Learning Syntax and Lexicon. ICLR (Poster) (2018)
Nan Jiang, Wenge Rong, Yifan Nie, Yikang Shen, Zhang Xiong
Biological Event Trigger Identification with Noise Contrastive Estimation. IEEE ACM Trans. Comput. Biol. Bioinform. 15 (5) (2018)
Yikang Shen, Shawn Tan, Chin-Wei Huang, Aaron C. Courville
Generating Contradictory, Neutral, and Entailing Sentences. CoRR (2018)
Yue Dong, Yikang Shen, Eric Crawford, Herke van Hoof, Jackie Chi Kit Cheung
BanditSum: Extractive Summarization as a Contextual Bandit. EMNLP (2018)
Yue Dong, Yikang Shen, Eric Crawford, Herke van Hoof, Jackie Chi Kit Cheung
BanditSum: Extractive Summarization as a Contextual Bandit. CoRR (2018)
Yikang Shen, Shawn Tan, Alessandro Sordoni, Aaron C. Courville
Ordered Neurons: Integrating Tree Structures into Recurrent Neural Networks. CoRR (2018)
Yikang Shen, Wenge Rong, Nan Jiang, Baolin Peng, Jie Tang, Zhang Xiong
Word Embedding Based Correlation Model for Question/Answer Matching. AAAI (2017)
Yikang Shen, Zhouhan Lin, Chin-Wei Huang, Aaron C. Courville
Neural Language Modeling by Jointly Learning Syntax and Lexicon. CoRR (2017)
Yikang Shen, Shawn Tan, Christopher Joseph Pal, Aaron C. Courville
Self-organized Hierarchical Softmax. CoRR (2017)
Nan Jiang, Wenge Rong, Min Gao, Yikang Shen, Zhang Xiong
Exploration of Tree-based Hierarchical Softmax for Recurrent Language Models. IJCAI (2017)
Siqi Xiang, Wenge Rong, Yikang Shen, Yuanxin Ouyang, Zhang Xiong
Multidimensional scaling based knowledge provision for new questions in community Question Answering systems. IJCNN (2016)
Yazhi Gao, Wenge Rong, Yikang Shen, Zhang Xiong
Convolutional Neural Network based sentiment analysis using Adaboost combination. IJCNN (2016)
Yikang Shen, Wenge Rong, Zhiwei Sun, Yuanxin Ouyang, Zhang Xiong
Question/Answer Matching for CQA System via Combining Lexical and Sequential Information. AAAI (2015)
Yikang Shen, Wenge Rong, Nan Jiang, Baolin Peng, Jie Tang, Zhang Xiong
Word Embedding based Correlation Model for Question/Answer Matching. CoRR (2015)
Yifan Nie, Wenge Rong, Yikang Shen, Chao Li, Zhang Xiong
Choosing the Best Auto-Encoder-Based Bagging Classifier: An Empirical Study. ICONIP (1) (2014)
Zhiwei Sun, Wenge Rong, Yikang Shen, Yuanxin Ouyang, Chao Li, Zhang Xiong
Influencing Factors Analysis of People's Answering Behaviours on Social Network Based Questions. UIC/ATC/ScalCom (2014)