Runyi (Ingrid) Yu

PhD Student

Hong Kong University of Science and Technology
Clear Water Bay, Kowloon, HongKong.

Email: ingrid.yu [at] connect [dot] ust [dot] hk

Biography

I am a final (3rd) year phd student at HKUST, supervised by Qifeng Chen. I obtained my Master's Degree from Peking University in 2024 and Bachelor's Degree from Beijing Normal University in 2021. I used to be an intern at MSRA.

My research interests include Robotics, Computer Vision, Machine Learning and their intersections. From 2021 to 2022, I focused on the Transformer-based Understanding researches. From 2023 to 2024, I worked on image/video generation and talking head generation. Now, I am exploring the Physics Animation.

Cooperation and discussion are welcomed.

I am actively looking for my next role. Contact me if you know of a good fit!

News

[03/2025] One paper was accepted by CORL 2026 .
[03/2025] One paper was accepted by SIGGRAPH 2025 .
[02/2025] One paper was accepted as 🏆 Highlight in CVPR 2025 .
[12/2024] One paper was accepted by AAAI 2025 .
[07/2024] One paper was accepted by ECCV 2024 .
[06/2024] Graduated from Peking University .
[10/2023] One paper was accepted by ICLR 2024 .
[06/2023] One paper was accepted by ICCV 2023 .
[06/2023] One paper was accepted as 🏆 Oral in CVPR Workshop 2023 .
[02/2023] One paper was accepted as 🏆 Highlight in CVPR 2023 .
[07/2022] One paper was accepted by ECCV 2022 .
[06/2021] Graduated from Beijing Normal University .

Internship

Microsoft Research Asia

Apr. 2023 - Mar. 2024, Beijing, China

closely worked with Tianyu He and Xu Tan

Topic: Talking Head Generation

Education

The Hong Kong University of Science and Technology, Hong Kong

PhD Student in Visual Intelligence Lab, HKUST

Advisor: Prof. Qifeng Chen

Sep. 2024 - Future

Peking University, China

Master of Science in Computer Science

Advisor: Prof. Jie Chen

Sep. 2021 - Jun. 2024

Beijing Normal Univesity, China

Bachelor of Management in Information Systems

Sep. 2017 - Jun. 2021

Selected Publications

Physics Animation
	HiPHI: A Large-Scale Benchmark for High-Precision Human Motion and Object-Interaction CORL 2026 Jiahao Ji, Ji Ma, Runhan Zhang, Runyi Yu*, Wenjia Wang, Weiheng Chi, Qianqian Peng, Weichao Yan, Yongfei Gu, Ye Tian, Ting Wu, Longwei Li, Chun Yuan, Ruoli Dai, Lei Han [paper] [project page] [code]
	HOT: Learning Generalizable Hand-Object Tracking from Synthetic Demonstrations In Submission Runyi Yu, Hok Wai Tsui, Xiaoyi Lin, Yinhuai Wang, Hui Zhang, Qihan Zhao, Ke Fan,Miao Li, Jie Song, Jingbo Wang, Qifeng Chen, Ping Tan [paper] [project page] [code]
	SkillMimic-V2: Learning Robust and Generalizable Interaction Skills from Sparse and Noisy Demonstrations SIGGRAPH 2025 Runyi Yu, Yinhuai Wang, Qihan Zhao*, Hok Wai Tsui, Jingbo Wang, Ping Tan, Qifeng Chen [paper] [project page] [code]
	SkillMimic: Learning Basketball Interaction Skills from Demonstrations 🏆 CVPR 2025 Highlight Yinhuai Wang, Qihan Zhao, Runyi Yu*, Hok Wai Tsui, Ailing Zeng, Jing Lin, Zhengyi Luo, Jiwen Yu, Xiu Li, Qifeng Chen, Jian Zhang, Lei Zhang, Ping Tan [paper] [project page] [code]
Talking Head
	Make Your Actor Talk: Generalizable and High-Fidelity Lip Sync with Motion and Appearance Disentanglement Preprint Arxiv Runyi Yu, Tianyu He, Ailing Zhang, Yuchi Wang, Junliang Guo, Xu Tan, Chang Liu, Jie Chen, Jiang Bian [paper] [project page]
	GAIA: Data-driven Zero-shot Talking Avatar Generation Tianyu He, Junliang Guo, Runyi Yu, Yuchi Wang, Jialiang Zhu, Kaikai An, Leyi Li, Xu Tan, Chunyu Wang, Han Hu, HsiangTao Wu, Sheng Zhao, Jiang Bian ICLR 2024 [paper] [project page]
Computer Vision
	LaPE: Layer-adaptive Position Embedding for Vision Transformers with Independent Layer Normalization Runyi Yu, Zhennan Wang, Yinhuai Wang, Kehan Li, Chang Liu, Haoyi Duan, Xiangyang Ji, Jie Chen ICCV 2023* [paper] [code]
	Locality guidance for improving vision transformers on tiny datasets Kehan Li, Runyi Yu, Zhennan Wang, Li Yuan, Guoli Song, Jie Chen ECCV 2022 [paper] [code]

Community Services

Conference Reviewer

CORL 2026 Siggraph 2026 ECCV 2026 CVPR 2026 ICCV 2025 AAAI 2026
Journal Reviewer

IEEE Transactions on Multimedia (TMM)

Physics Animation
	HiPHI: A Large-Scale Benchmark for High-Precision Human Motion and Object-Interaction CORL 2026 Jiahao Ji, Ji Ma, Runhan Zhang, Runyi Yu*, Wenjia Wang, Weiheng Chi, Qianqian Peng, Weichao Yan, Yongfei Gu, Ye Tian, Ting Wu, Longwei Li, Chun Yuan, Ruoli Dai, Lei Han [paper] [project page] [code]
	HOT: Learning Generalizable Hand-Object Tracking from Synthetic Demonstrations In Submission Runyi Yu, Hok Wai Tsui, Xiaoyi Lin, Yinhuai Wang, Hui Zhang, Qihan Zhao, Ke Fan,Miao Li, Jie Song, Jingbo Wang, Qifeng Chen, Ping Tan [paper] [project page] [code]
	SkillMimic-V2: Learning Robust and Generalizable Interaction Skills from Sparse and Noisy Demonstrations SIGGRAPH 2025 Runyi Yu, Yinhuai Wang, Qihan Zhao*, Hok Wai Tsui, Jingbo Wang, Ping Tan, Qifeng Chen [paper] [project page] [code]
	SkillMimic: Learning Basketball Interaction Skills from Demonstrations 🏆 CVPR 2025 Highlight Yinhuai Wang, Qihan Zhao, Runyi Yu*, Hok Wai Tsui, Ailing Zeng, Jing Lin, Zhengyi Luo, Jiwen Yu, Xiu Li, Qifeng Chen, Jian Zhang, Lei Zhang, Ping Tan [paper] [project page] [code]
Talking Head
	Make Your Actor Talk: Generalizable and High-Fidelity Lip Sync with Motion and Appearance Disentanglement Preprint Arxiv Runyi Yu, Tianyu He, Ailing Zhang, Yuchi Wang, Junliang Guo, Xu Tan, Chang Liu, Jie Chen, Jiang Bian [paper] [project page]
	GAIA: Data-driven Zero-shot Talking Avatar Generation Tianyu He, Junliang Guo, Runyi Yu, Yuchi Wang, Jialiang Zhu, Kaikai An, Leyi Li, Xu Tan, Chunyu Wang, Han Hu, HsiangTao Wu, Sheng Zhao, Jiang Bian ICLR 2024 [paper] [project page]
Computer Vision
	LaPE: Layer-adaptive Position Embedding for Vision Transformers with Independent Layer Normalization Runyi Yu, Zhennan Wang, Yinhuai Wang, Kehan Li, Chang Liu, Haoyi Duan, Xiangyang Ji, Jie Chen ICCV 2023* [paper] [code]
	Locality guidance for improving vision transformers on tiny datasets Kehan Li, Runyi Yu, Zhennan Wang, Li Yuan, Guoli Song, Jie Chen ECCV 2022 [paper] [code]