Sinong Wang

Publication Activity (10 Years)

Years Active: 2013-2024
Publications (10 Years): 60

Top Topics

Linear Transform

Fundamental Limits

Top Venues

Proc. ACM Meas. Anal. Comput. Syst.

EMNLP (Findings)

Publications

Wenhan Xiong, Jingyu Liu, Igor Molybog, Hejia Zhang, Prajjwal Bhargava, Rui Hou, Louis Martin, Rashi Rungta, Karthik Abinav Sankararaman, Barlas Oguz, Madian Khabsa, Han Fang, Yashar Mehdad, Sharan Narang, Kshitiz Malik, Angela Fan, Shruti Bhosale, Sergey Edunov, Mike Lewis, Sinong Wang, Hao Ma
Effective Long-Context Scaling of Foundation Models. NAACL-HLT (2024)
Yu Meng, Jitin Krishnan, Sinong Wang, Qifan Wang, Yuning Mao, Han Fang, Marjan Ghazvininejad, Jiawei Han, Luke Zettlemoyer
Representation Deficiency in Masked Language Modeling. ICLR (2024)
Chiyu Zhang, Yifei Sun, Jun Chen, Jie Lei, Muhammad Abdul-Mageed, Sinong Wang, Rong Jin, Sem Park, Ning Yao, Bo Long
SPAR: Personalized Content-Based Recommendation via Long Engagement Attention. CoRR (2024)
Xingyuan Li, Sinong Wang, Zeyu Xie, Mengyue Wu, Kenny Q. Zhu
Phonetic and Lexical Discovery of a Canine Language using HuBERT. CoRR (2024)
Chi Han, Qifan Wang, Hao Peng, Wenhan Xiong, Yu Chen, Heng Ji, Sinong Wang
LM-Infinite: Zero-Shot Extreme Length Generalization for Large Language Models. NAACL-HLT (2024)
Qifan Wang, Jingang Wang, Xiaojun Quan, Fuli Feng, Zenglin Xu, Shaoliang Nie, Sinong Wang, Madian Khabsa, Hamed Firooz, Dongfang Liu
MUSTIE: Multimodal Structural Transformer for Web Information Extraction. ACL (1) (2023)
Qifan Wang, Yuning Mao, Jingang Wang, Hanchao Yu, Shaoliang Nie, Sinong Wang, Fuli Feng, Lifu Huang, Xiaojun Quan, Zenglin Xu, Dongfang Liu
APrompt: Attention Prompt Tuning for Efficient Adaptation of Pre-trained Language Models. EMNLP (2023)
Yu Meng, Jitin Krishnan, Sinong Wang, Qifan Wang, Yuning Mao, Han Fang, Marjan Ghazvininejad, Jiawei Han, Luke Zettlemoyer
Representation Deficiency in Masked Language Modeling. CoRR (2023)
Li Yang, Qifan Wang, Jingang Wang, Xiaojun Quan, Fuli Feng, Yu Chen, Madian Khabsa, Sinong Wang, Zenglin Xu, Dongfang Liu
MixPAVE: Mix-Prompt Tuning for Few-shot Product Attribute Value Extraction. ACL (Findings) (2023)
Wenhan Xiong, Jingyu Liu, Igor Molybog, Hejia Zhang, Prajjwal Bhargava, Rui Hou, Louis Martin, Rashi Rungta, Karthik Abinav Sankararaman, Barlas Oguz, Madian Khabsa, Han Fang, Yashar Mehdad, Sharan Narang, Kshitiz Malik, Angela Fan, Shruti Bhosale, Sergey Edunov, Mike Lewis, Sinong Wang, Hao Ma
Effective Long-Context Scaling of Foundation Models. CoRR (2023)
Chi Han, Qifan Wang, Wenhan Xiong, Yu Chen, Heng Ji, Sinong Wang
LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models. CoRR (2023)
Ajinkya Tejankar, Maziar Sanjabi, Qifan Wang, Sinong Wang, Hamed Firooz, Hamed Pirsiavash, Liang Tan
Defending Against Patch-based Backdoor Attacks on Self-Supervised Learning. CVPR (2023)
Kuan-Hao Huang, Liang Tan, Rui Hou, Sinong Wang, Amjad Almahairi, Ruty Rinott
Learning Easily Updated General Purpose Text Representations with Adaptable Task-Specific Prefix. EMNLP (Findings) (2023)
Kuan-Hao Huang, Liang Tan, Rui Hou, Sinong Wang, Amjad Almahairi, Ruty Rinott
Learning Easily Updated General Purpose Text Representations with Adaptable Task-Specific Prefixes. CoRR (2023)
Ajinkya Tejankar, Maziar Sanjabi, Qifan Wang, Sinong Wang, Hamed Firooz, Hamed Pirsiavash, Liang Tan
Defending Against Patch-based Backdoor Attacks on Self-Supervised Learning. CoRR (2023)
Qifan Wang, Li Yang, Jingang Wang, Jitin Krishnan, Bo Dai, Sinong Wang, Zenglin Xu, Madian Khabsa, Hao Ma
SMARTAVE: Structured Multimodal Transformer for Product Attribute Value Extraction. EMNLP (Findings) (2022)
Khalil Mrini, Shaoliang Nie, Jiatao Gu, Sinong Wang, Maziar Sanjabi, Hamed Firooz
Detection, Disambiguation, Re-ranking: Autoregressive Entity Linking as a Multi-Task Problem. ACL (Findings) (2022)
Qinyuan Ye, Madian Khabsa, Mike Lewis, Sinong Wang, Xiang Ren, Aaron Jaech
Sparse Distillation: Speeding Up Text Classification by Using Bigger Student Models. NAACL-HLT (2022)
Qifan Wang, Li Yang, Xiaojun Quan, Fuli Feng, Dongfang Liu, Zenglin Xu, Sinong Wang, Hao Ma
Learning to Generate Question by Asking Question: A Primal-Dual Approach with Uncommon Word Generation. EMNLP (2022)
Zhuofeng Wu, Sinong Wang, Jiatao Gu, Rui Hou, Yuxiao Dong, V. G. Vinod Vydiswaran, Hao Ma
IDPG: An Instance-Dependent Prompt Generation Method. NAACL-HLT (2022)
Zhuofeng Wu, Sinong Wang, Jiatao Gu, Rui Hou, Yuxiao Dong, V. G. Vinod Vydiswaran, Hao Ma
IDPG: An Instance-Dependent Prompt Generation Method. CoRR (2022)
Khalil Mrini, Shaoliang Nie, Jiatao Gu, Sinong Wang, Maziar Sanjabi, Hamed Firooz
Detection, Disambiguation, Re-ranking: Autoregressive Entity Linking as a Multi-Task Problem. CoRR (2022)
Yifang Chen, Karthik Abinav Sankararaman, Alessandro Lazaric, Matteo Pirotta, Dmytro Karamshuk, Qifan Wang, Karishma Mandyam, Sinong Wang, Han Fang
Improved Adaptive Algorithm for Scalable Active Learning with Weak Labeler. CoRR (2022)
Karthik Abinav Sankararaman, Sinong Wang, Han Fang
BayesFormer: Transformer with Uncertainty Estimation. CoRR (2022)
Sinong Wang, Han Fang, Madian Khabsa, Hanzi Mao, Hao Ma
Entailment as Few-Shot Learner. CoRR (2021)
Qinyuan Ye, Belinda Z. Li, Sinong Wang, Benjamin Bolte, Hao Ma, Wen-tau Yih, Xiang Ren, Madian Khabsa
On the Influence of Masking Policies in Intermediate Pre-training. EMNLP (1) (2021)
Nayeon Lee, Belinda Z. Li, Sinong Wang, Pascale Fung, Hao Ma, Wen-tau Yih, Madian Khabsa
On Unifying Misinformation Detection. CoRR (2021)
Nayeon Lee, Belinda Z. Li, Sinong Wang, Pascale Fung, Hao Ma, Wen-tau Yih, Madian Khabsa
On Unifying Misinformation Detection. NAACL-HLT (2021)
Darsh J. Shah, Sinong Wang, Han Fang, Hao Ma, Luke Zettlemoyer
Reducing Target Group Bias in Hate Speech Detectors. CoRR (2021)
Qinyuan Ye, Madian Khabsa, Mike Lewis, Sinong Wang, Xiang Ren, Aaron Jaech
Sparse Distillation: Speeding Up Text Classification by Using Bigger Models. CoRR (2021)
Qinyuan Ye, Belinda Z. Li, Sinong Wang, Benjamin Bolte, Hao Ma, Wen-tau Yih, Xiang Ren, Madian Khabsa
On the Influence of Masking Policies in Intermediate Pre-training. CoRR (2021)
Xuezhe Ma, Xiang Kong, Sinong Wang, Chunting Zhou, Jonathan May, Hao Ma, Luke Zettlemoyer
Luna: Linear Unified Nested Attention. NeurIPS (2021)
Xuezhe Ma, Xiang Kong, Sinong Wang, Chunting Zhou, Jonathan May, Hao Ma, Luke Zettlemoyer
Luna: Linear Unified Nested Attention. CoRR (2021)
Zhuofeng Wu, Sinong Wang, Jiatao Gu, Madian Khabsa, Fei Sun, Hao Ma
CLEAR: Contrastive Learning for Sentence Representation. CoRR (2020)
Sinong Wang, Madian Khabsa, Hao Ma
To Pretrain or Not to Pretrain: Examining the Benefits of Pretrainng on Resource Rich Tasks. ACL (2020)
Nayeon Lee, Belinda Z. Li, Sinong Wang, Wen-tau Yih, Hao Ma, Madian Khabsa
Language Models as Fact Checkers? CoRR (2020)
Jiezhong Qiu, Hao Ma, Omer Levy, Wen-tau Yih, Sinong Wang, Jie Tang
Blockwise Self-Attention for Long Document Understanding. EMNLP (Findings) (2020)
Sinong Wang, Madian Khabsa, Hao Ma
To Pretrain or Not to Pretrain: Examining the Benefits of Pretraining on Resource Rich Tasks. CoRR (2020)
Qinyuan Ye, Belinda Z. Li, Sinong Wang, Benjamin Bolte, Hao Ma, Wen-tau Yih, Xiang Ren, Madian Khabsa
Studying Strategically: Learning to Mask for Closed-book QA. CoRR (2020)
Sinong Wang, Belinda Z. Li, Madian Khabsa, Han Fang, Hao Ma
Linformer: Self-Attention with Linear Complexity. CoRR (2020)
Sinong Wang, Jiashang Liu, Ness B. Shroff
Fundamental Limits of Approximate Gradient Coding. SIGMETRICS (Abstracts) (2020)
Jiezhong Qiu, Hao Ma, Omer Levy, Scott Wen-tau Yih, Sinong Wang, Jie Tang
Blockwise Self-Attention for Long Document Understanding. CoRR (2019)
Sinong Wang, Jiashang Liu, Ness B. Shroff
Fundamental Limits of Approximate Gradient Coding. CoRR (2019)
Sinong Wang, Jiashang Liu, Ness B. Shroff, Pengyu Yang
Computation Efficient Coded Linear Transform. AISTATS (2019)
Sinong Wang, Jiashang Liu, Ness B. Shroff
Fundamental Limits of Approximate Gradient Coding. Proc. ACM Meas. Anal. Comput. Syst. 3 (3) (2019)
Sinong Wang, Ness B. Shroff
Towards Fast-Convergence, Low-Delay and Low-Complexity Network Optimization. SIGMETRICS (Abstracts) (2018)
Fang Liu, Sinong Wang, Swapna Buccapatnam, Ness B. Shroff
UCBoost: A Boosting Approach to Tame Complexity and Optimality for Stochastic Bandits. IJCAI (2018)
Jiashang Liu, Joohyun Lee, Ness B. Shroff, Prasun Sinha, Sinong Wang
A Near-Optimal Control Policy in Cloud Systems with Renewable Sources and Time-Dependent Energy Price. IEEE CLOUD (2018)
Sinong Wang, Jiashang Liu, Ness B. Shroff
Coded Sparse Matrix Multiplication. CoRR (2018)
Sinong Wang, Jiashang Liu, Ness B. Shroff
Coded Sparse Matrix Multiplication. ICML (2018)
Sinong Wang, Jiashang Liu, Ness B. Shroff, Pengyu Yang
Fundamental Limits of Coded Linear Transform. CoRR (2018)
Fang Liu, Sinong Wang, Swapna Buccapatnam, Ness B. Shroff
UCBoost: A Boosting Approach to Tame Complexity and Optimality for Stochastic Bandits. CoRR (2018)
Sinong Wang, Ness B. Shroff
Towards Fast-Convergence, Low-Delay and Low-Complexity Network Optimization. Proc. ACM Meas. Anal. Comput. Syst. 1 (2) (2017)
Sinong Wang, Fang Liu, Ness B. Shroff
Non-Additive Security Games. AAAI (2017)
Sinong Wang, Ness B. Shroff
Security Game with Non-additive Utilities and Multiple Attacker Resources. Proc. ACM Meas. Anal. Comput. Syst. 1 (1) (2017)
Sinong Wang, Ness B. Shroff
Security Game with Non-additive Utilities and Multiple Attacker Resources. SIGMETRICS (Abstracts) (2017)
Sinong Wang, Ness B. Shroff
A New Alternating Direction Method for Linear Programming. NIPS (2017)
Sinong Wang, Ness B. Shroff
Towards Fast-Convergence, Low-Delay and Low-Complexity Network Optimization. CoRR (2017)
Sinong Wang, Ness B. Shroff
Security Game with Non-additive Utilities and Multiple Attacker Resources. CoRR (2017)
Sinong Wang, Fang Liu, Ness B. Shroff
Non-additive Security Game. CoRR (2016)
Sinong Wang, Wenxin Li, Xiaohua Tian, Hui Liu
Fundamental Limits of Heterogenous Cache. CoRR (2015)
Sinong Wang, Xiaohua Tian, Hui Liu
Exploiting the unexploited of coded caching for wireless content distribution. ICNC (2015)
Wei Huang, Sinong Wang, Lianghui Ding, Feng Yang, Wenjun Zhang
The Performance Analysis of Coded Cache in Wireless Fading Channel. CoRR (2015)
Sinong Wang, Xiaohua Tian, Hui Liu
Exploiting the Unexploited of Coded Caching for Wireless Content Distribution: Detailed Theoretical Proofs. CoRR (2014)
Zhe Liu, Sinong Wang, Weijie Wu, Xiaohua Tian, Changle Li, Xinbing Wang
A predictive methodology for truthful double spectrum auctions in cognitive radio networks. GLOBECOM (2014)
Sinong Wang, Huaxi Gu, Gang Wu
A New Approach to Multi-objective Virtual Machine Placement in Virtualized Data Center. NAS (2013)