Yang Li

ORCID

Publication Activity (10 Years)

Years Active: 2009-2024
Publications (10 Years): 72

Top Venues

Publications

Tao Li, Chin-Yi Cheng, Amber Xie, Gang Li, Yang Li
Revision Matters: Generative Design Guided by Revision Edits. CoRR (2024)
Forrest Huang, Gang Li, Tao Li, Yang Li
Automatic Macro Mining from Interaction Traces at Scale. CHI (2024)
Tao Li, Gang Li, Jingjie Zheng, Purple Wang, Yang Li
MUG: Interactive Multimodal Grounding on User Interfaces. EACL (Findings) (2024)
Peitong Duan, Chin-yi Chen, Gang Li, Bjoern Hartmann, Yang Li
UICrit: Enhancing Automated Design Evaluation with a UICritique Dataset. CoRR (2024)
Chin-Yi Cheng, Ruiqi Gao, Forrest Huang, Yang Li
CoLay: Controllable Layout Generation through Multi-conditional Latent Diffusion. CoRR (2024)
Peitong Duan, Jeremy Warner, Yang Li, Bjoern Hartmann
Generating Automatic Feedback on UI Mockups with Large Language Models. CoRR (2024)
Yang Li, Juan Liu, Jin Huang, Yang Zhang, Xiaolan Peng, Yulong Bian, Feng Tian
Evaluating the effects of user motion and viewing mode on target selection in augmented reality. Int. J. Hum. Comput. Stud. 191 (2024)
Peitong Duan, Jeremy Warner, Yang Li, Bjoern Hartmann
Generating Automatic Feedback on UI Mockups with Large Language Models. CHI (2024)
Tao Li, Gang Li, Zhiwei Deng, Bryan Wang, Yang Li
A Zero-Shot Language Agent for Computer Control with Structured Reflection. CoRR (2023)
Hongyan Gu, Yuan Liang, Yifan Xu, Christopher Kazu Williams, Shino Magaki, Negar Khanlou, Harry Vinters, Zesheng Chen, Shuo Ni, Chunxu Yang, Wenzhong Yan, Xinhai Robert Zhang, Yang Li, Mohammad Haeri, Xiang 'Anthony' Chen
Improving Workflow Integration with xPath: Design and Evaluation of a Human-AI Diagnosis System in Pathology. ACM Trans. Comput. Hum. Interact. 30 (2) (2023)
Michael Xuelin Huang, Yang Li, Nazneen Nazneen, Alexander Chao, Shumin Zhai
TapNet: The Design, Training, Implementation, and Applications of a Multi-Task Learning CNN for Off-Screen Mobile Input. CoRR (2021)
Mingyuan Zhong, Gang Li, Peggy Chi, Yang Li
HelpViz: Automatic Generation of Contextual Visual Mobile Tutorials from Text-Based Instructions. UIST (2021)
Bryan Wang, Gang Li, Xin Zhou, Zhourong Chen, Tovi Grossman, Yang Li
Screen2Words: Automatic Mobile UI Summarization with Multimodal Learning. CoRR (2021)
Mingyuan Zhong, Gang Li, Peggy Chi, Yang Li
HelpViz: Automatic Generation of Contextual Visual MobileTutorials from Text-Based Instructions. CoRR (2021)
Xin Zhou, Yang Li
Large-Scale Modeling of Mobile User Click Behaviors Using Deep Learning. CoRR (2021)
Bryan Wang, Gang Li, Xin Zhou, Zhourong Chen, Tovi Grossman, Yang Li
Screen2Words: Automatic Mobile UI Summarization with Multimodal Learning. UIST (2021)
Xin Zhou, Yang Li
Large-Scale Modeling of Mobile User Click Behaviors Using Deep Learning. RecSys (2021)
Mingyuan Zhong, Gang Li, Yang Li
Spacewalker: Rapid UI Design Exploration Using Lightweight Markup Enhancement and Crowd Genetic Programming. CoRR (2021)
Yang Li, Gang Li, Xin Zhou, Mostafa Dehghani, Alexey A. Gritsenko
VUT: Versatile UI Transformer for Multi-Modal Multi-Task User Interface Modeling. CoRR (2021)
Michael Xuelin Huang, Yang Li, Nazneen Nazneen, Alexander Chao, Shumin Zhai
TapNet: The Design, Training, Implementation, and Applications of a Multi-Task Learning CNN for Off-Screen Mobile Input. CHI (2021)
Forrest Huang, Gang Li, Xin Zhou, John F. Canny, Yang Li
Creating User Interface Mock-ups from High-Level Text Descriptions with Deep-Learning Models. CoRR (2021)
Yang Li, Si Si, Gang Li, Cho-Jui Hsieh, Samy Bengio
Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding. CoRR (2021)
Yang Li, Si Si, Gang Li, Cho-Jui Hsieh, Samy Bengio
Learnable Fourier Features for Multi-dimensional Spatial Positional Encoding. NeurIPS (2021)
Mingyuan Zhong, Gang Li, Yang Li
Spacewalker: Rapid UI Design Exploration Using Lightweight Markup Enhancement and Crowd Genetic Programming. CHI (2021)
Arianna Yuan, Yang Li
Modeling Human Visual Search Performance on Realistic Webpages Using Analytical and Deep Learning Methods. CHI (2020)
Yang Li, Ranjitha Kumar, Walter S. Lasecki, Otmar Hilliges
Artificial Intelligence for HCI: A Modern Approach. CHI Extended Abstracts (2020)
Yang Li, Gang Li, Luheng He, Jingjie Zheng, Hong Li, Zhiwei Guan
Widget Captioning: Generating Natural Language Description for Mobile User Interface Elements. CoRR (2020)
Yang Li, Jiacong He, Xin Zhou, Yuan Zhang, Jason Baldridge
Mapping Natural Language Instructions to Mobile UI Action Sequences. CoRR (2020)
Yang Li, Julien Amelot, Xin Zhou, Samy Bengio, Si Si
Auto Completion of User Interface Layout Design Using Transformer-Based Tree Decoders. CoRR (2020)
Arianna Yuan, Yang Li
Modeling Human Visual Search Performance on Realistic Webpages Using Analytical and Deep Learning Methods. CoRR (2020)
Hongge Chen, Si Si, Yang Li, Ciprian Chelba, Sanjiv Kumar, Duane S. Boning, Cho-Jui Hsieh
Multi-Stage Influence Function. NeurIPS (2020)
Yang Li, Gang Li, Luheng He, Jingjie Zheng, Hong Li, Zhiwei Guan
Widget Captioning: Generating Natural Language Description for Mobile User Interface Elements. EMNLP (1) (2020)
Hongge Chen, Si Si, Yang Li, Ciprian Chelba, Sanjiv Kumar, Duane S. Boning, Cho-Jui Hsieh
Multi-Stage Influence Function. CoRR (2020)
Yang Li, Jiacong He, Xin Zhou, Yuan Zhang, Jason Baldridge
Mapping Natural Language Instructions to Mobile UI Action Sequences. ACL (2020)
Wei-Lin Chiang, Xuanqing Liu, Si Si, Yang Li, Samy Bengio, Cho-Jui Hsieh
Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networks. CoRR (2019)
Hongge Chen, Huan Zhang, Si Si, Yang Li, Duane S. Boning, Cho-Jui Hsieh
Robustness Verification of Tree-based Models. NeurIPS (2019)
Xuanqing Liu, Si Si, Xiaojin Zhu, Yang Li, Cho-Jui Hsieh
A Unified Framework for Data Poisoning Attack to Graph-based Semi-supervised Learning. CoRR (2019)
Patrick H. Chen, Si Si, Sanjiv Kumar, Yang Li, Cho-Jui Hsieh
Learning to Screen for Fast Softmax Inference on Large Vocabulary Neural Networks. ICLR (Poster) (2019)
Zhourong Chen, Yang Li, Samy Bengio, Si Si
You Look Twice: GaterNet for Dynamic Filter Selection in CNNs. CVPR (2019)
Amanda Swearngin, Yang Li
Modeling Mobile Interface Tappability Using Crowdsourcing and Deep Learning. CHI (2019)
Yang Li, Lukasz Kaiser, Samy Bengio, Si Si
Area Attention. ICML (2019)
Wei-Lin Chiang, Xuanqing Liu, Si Si, Yang Li, Samy Bengio, Cho-Jui Hsieh
Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networks. KDD (2019)
Hongge Chen, Huan Zhang, Si Si, Yang Li, Duane S. Boning, Cho-Jui Hsieh
Robustness Verification of Tree-based Models. CoRR (2019)
Amanda Swearngin, Yang Li
Modeling Mobile Interface Tappability Using Crowdsourcing and Deep Learning. CoRR (2019)
Runchang Kang, Anhong Guo, Gierad Laput, Yang Li, Xiang 'Anthony' Chen
Minuet: Multimodal Interaction with an Internet of Things. SUI (2019)
Xuanqing Liu, Si Si, Jerry Zhu, Yang Li, Cho-Jui Hsieh
A Unified Framework for Data Poisoning Attack to Graph-based Semi-supervised Learning. NeurIPS (2019)
Yang Li, Samy Bengio, Gilles Bailly
Predicting Human Performance in Vertical Menu Selection Using Deep Learning. CoRR (2018)
Pei-Yu (Peggy) Chi, Sen-Po Hu, Yang Li
Doppio: Tracking UI Flows and Code Changes for App Development. CHI (2018)
Patrick H. Chen, Si Si, Yang Li, Ciprian Chelba, Cho-Jui Hsieh
GroupReduce: Block-Wise Low-Rank Approximation for Neural Language Model Shrinking. CoRR (2018)
Yang Li, Lukasz Kaiser, Samy Bengio, Si Si
Area Attention. CoRR (2018)
Junjun Fan, Xiangmin Fan, Feng Tian, Yang Li, Zitao Liu, Wei Sun, Hongan Wang
What is That in Your Hand?: Recognizing Grasped Objects via Forearm Electromyography Sensing. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2 (4) (2018)
Anhong Guo, Saige McVea, Xu Wang, Patrick Clary, Ken Goldman, Yang Li, Yu Zhong, Jeffrey P. Bigham
Investigating Cursor-based Interactions to Support Non-Visual Exploration in the Real World. ASSETS (2018)
Jingjie Zheng, Xiaojun Bi, Kun Li, Yang Li, Shumin Zhai
M3 Gesture Menu: Design and Experimental Analyses of Marking Menus for Touchscreen Mobile Interaction. CHI (2018)
Patrick H. Chen, Si Si, Sanjiv Kumar, Yang Li, Cho-Jui Hsieh
Learning to Screen for Fast Softmax Inference on Large Vocabulary Neural Networks. CoRR (2018)
Ken Pfeuffer, Yang Li
Analysis and Modeling of Grid Performance on Touchscreen Mobile Devices. CHI (2018)
Patrick H. Chen, Si Si, Yang Li, Ciprian Chelba, Cho-Jui Hsieh
GroupReduce: Block-Wise Low-Rank Approximation for Neural Language Model Shrinking. NeurIPS (2018)
Zhourong Chen, Yang Li, Samy Bengio, Si Si
GaterNet: Dynamic Filter Selection in Convolutional Neural Network via a Dedicated Global Gating Network. CoRR (2018)
Yang Li, Samy Bengio, Gilles Bailly
Predicting Human Performance in Vertical Menu Selection Using Deep Learning. CHI (2018)
Yang Li, Nan Du, Samy Bengio
Time-Dependent Representation for Neural Event Sequence Prediction. ICLR (Workshop) (2018)
Biplab Deka, Zifeng Huang, Chad Franzen, Jeffrey Nichols, Yang Li, Ranjitha Kumar
ZIPT: Zero-Integration Performance Testing of Mobile App Designs. UIST (2017)
Biplab Deka, Zifeng Huang, Chad Franzen, Joshua Hibschman, Daniel Afergan, Yang Li, Jeffrey Nichols, Ranjitha Kumar
Rico: A Mobile App Dataset for Building Data-Driven Design Applications. UIST (2017)
Yang Li, Nan Du, Samy Bengio
Time-Dependent Representation for Neural Event Sequence Prediction. CoRR (2017)
Xiang 'Anthony' Chen, Yang Li
Improv: An Input Framework for Improvising Cross-Device Interaction by Demonstration. ACM Trans. Comput. Hum. Interact. 24 (2) (2017)
Sarah Morrison-Smith, Megan Hofmann, Yang Li, Jaime Ruiz
Using Audio Cues to Support Motion Gesture Interaction on Mobile Devices. ACM Trans. Appl. Percept. 13 (3) (2016)
Pei-Yu (Peggy) Chi, Yang Li, Björn Hartmann
Enhancing Cross-Device Interaction Scripting with Interactive Illustrations. CHI (2016)
Aman Parnami, Apurva Gupta, Gabriel Reyes, Ramik Sadana, Yang Li, Gregory D. Abowd
Mogeste: mobile tool for in-situ motion gesture design. UbiComp Adjunct (2016)
Ramik Sadana, Yang Li
Gesture morpher: video-based retargeting of multi-touch interactions. MobileHCI (2016)
Cheng Zhang, Anhong Guo, Dingtian Zhang, Yang Li, Caleb Southern, Rosa I. Arriaga, Gregory D. Abowd
Beyond the Touchscreen: An Exploration of Extending Interactions on Commodity Smartphones. ACM Trans. Interact. Intell. Syst. 6 (2) (2016)
Tao Dong, Michael Nebeling, Daniel Afergan, Elizabeth F. Churchill, Jeffrey Nichols, Elizabeth S. Goodman, Pei-Yu (Peggy) Chi, Yang Li, Daniel Wigdor
The Making of Cross-Device Experiences: A Hands-on Workshop. Conference on Designing Interactive Systems (Companion Volume) (2016)
Xiang 'Anthony' Chen, Yang Li
Bootstrapping User-Defined Body Tapping Recognition with Offline-Learned Probabilistic Representation. UIST (2016)
Michael Nebeling, Thomas Kubitza, Fabio Paternò, Tao Dong, Yang Li, Jeffrey Nichols
End-user development of cross-device user interfaces. EICS (2016)
Aman Parnami, Apurva Gupta, Gabriel Reyes, Ramik Sadana, Yang Li, Gregory D. Abowd
Mogeste: A Mobile Tool for In-Situ Motion Gesture Design. IHCI (2016)
Hao Lu, Yang Li
Gesture On: Enabling Always-On Touch Gestures for Fast Mobile Access from the Device Standby Mode. CHI (2015)
Pei-Yu (Peggy) Chi, Yang Li
Weave: Scripting Cross-Device Wearable Interaction. CHI (2015)
Haimo Zhang, Yang Li
GestKeyboard: enabling gesture-based interaction on ordinary physical keyboard. CHI Extended Abstracts (2014)
Yang Li
Reflection: enabling event prediction as an on-device service for mobile interaction. UIST (2014)
Fangzhou Wang, Yang Li, Daisuke Sakamoto, Takeo Igarashi
Hierarchical route maps for efficient navigation. IUI (2014)
Ankit Kamal, Yang Li, Edward Lank
Teaching motion gestures via recognizer feedback. IUI (2014)
Yi Ren, Yang Li, Edward Lank
InkAnchor: enhancing informal ink-based note taking on touchscreen mobile phones. CHI (2014)
Yang Li, Hao Lu, Haimo Zhang
Optimistic Programming of Touch Interaction. ACM Trans. Comput. Hum. Interact. 21 (4) (2014)
Haimo Zhang, Yang Li
GestKeyboard: enabling gesture-based interaction on ordinary physical keyboard. CHI (2014)
Hao Lü, Matei Negulescu, Yang Li
Gesturemote: interacting with remote displays through touch gestures. AVI (2014)
Hao Lü, James Fogarty, Yang Li
Gesture script: recognizing gestures and their structure using rendering scripts and interactively trained parts. CHI (2014)
Ben Zhang, Yu-Hsiang Chen, Claire Tuna, Achal Dave, Yang Li, Edward A. Lee, Björn Hartmann
HOBS: head orientation-based selection in physical spaces. SUI (2014)
William McGrath, Yang Li
Detecting tapping motion on the side of mobile devices by probabilistically combining hand postures. UIST (2014)
Matei Negulescu, Yang Li
Open project: a lightweight framework for remote sharing of mobile applications. UIST (2013)
Shahriyar Amini, Yang Li
CrowdLearner: rapidly creating mobile recognizers using crowdsourcing. UIST (2013)
Hao Lü, Yang Li
Gesture studio: authoring multi-touch interactions through demonstration and declaration. CHI (2013)
Xiaojun Bi, Yang Li, Shumin Zhai
FFitts law: modeling finger touch with fitts' law. CHI (2013)
Tom Ouyang, Yang Li
Bootstrapping personal gesture shortcuts with the wisdom of the crowd and handwriting recognition. CHI (2012)
Yang Li
Gesture Search: Random Access to Smartphone Content. IEEE Pervasive Comput. 11 (1) (2012)
Yang Li
Gesture-based interaction: a new dimension for mobile user interfaces. AVI (2012)
Hao Lü, Yang Li
Gesture coder: a tool for programming multi-touch gestures by demonstration. CHI (2012)
Matei Negulescu, Jaime Ruiz, Yang Li, Edward Lank
Tap, swipe, or move: attentional demands for distracted smartphone input. AVI (2012)
Hao Lü, Yang Li
Gesture avatar: a technique for operating mobile user interfaces using gestures. CHI (2011)
Jaime Ruiz, Yang Li
DoubleFlip: a motion gesture delimiter for mobile interaction. CHI (2011)
Tsung-Hsiang Chang, Yang Li
Deep shot: a framework for migrating tasks across devices using mobile phone cameras. CHI (2011)
Jaime Ruiz, Yang Li, Edward Lank
User-defined motion gestures for mobile interaction. CHI (2011)
Andrew Bragdon, Eugene Nelson, Yang Li, Ken Hinckley
Experimental analysis of touch-screen gesture designs in mobile environments. CHI (2011)
Yang Li
Gesture search: a tool for fast mobile data access. UIST (2010)

Yang Li.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

Yang Li