News
Selected Publications
For the full publication list, see Google Scholar.
|
RoboTok: An Internet-Scale Data Engine for Human Demonstration Retrieval and Dexterous Manipulation Learning
Howard H. Qian, Yiting Chen, Yunfei Xie, Kejia Ren, Podshara Chanrungmaneekul, Gaotian Wang, Bowen Wen, Chen Wei, Kaiyu Hang
Preprint (under review), 2026
paper / website
TL;DR. (Dexterous Manipulation Learning from Human Video) Built a scalable data engine to retrieve human demonstrations from internet videos through 3D hand-motion matching. Improved manipulation success in Isaac Gym simulation and zero-shot sim-to-real transfer to the LEAP Hand.
|
|
Sensorimotor Alignment: A Training-Free Predictor of Robot Policy Success
Yunfei Xie, Howard H. Qian, Shiyi Lan, Kaiyu Hang, Chen Wei
Preprint (under review), 2026
website
TL;DR. (Understanding Representations in Robot Foundation Models) Offered a representation-learning view of embodied model success. Found that models with higher task success show stronger alignment between their vision and language representations and motion-trajectory representations. Developed an offline proxy based on this finding to assess VLAs and WAMs before closed-loop evaluation, diagnose models, and explain empirically observed behaviors.
|
|
Play to Generalize: Learning to Reason Through Game Play
Yunfei Xie, Yinsong Ma, Shiyi Lan, Alan Yuille, Junfei Xiao, Chen Wei
ICLR 2026
website / paper
TL;DR. (RL for Multimodal Reasoning) Showed that RL post-training on simple arcade games improves multimodal LLMs' out-of-domain math and spatial reasoning without worked solutions or diagrams during that post-training stage.
|
|
MEMO: Memory-Augmented Model Context Optimization for Robust Multi-Turn Multi-Agent LLM Games
Yunfei Xie, Kevin Wang, Bobby Cheng, Jianzhu Yao, Zhizhou Sha, Alexander Duffy, Yihan Xi, Hongyuan Mei, Cheston Tan, Chen Wei, Pramod Viswanath, Zhangyang Wang
ICML 2026
paper / website / code
TL;DR. (Agent Memory and Self-Evolution) Built a self-play framework that distills agent trajectories into reusable insights stored in persistent memory and evolves agent prompts, improving performance and reducing run-to-run variance across five text games.
|
|
How Off-Policy Can GRPO Be? µ-GRPO for Efficient LLM Reinforcement Learning
Minghao Tian, Yunfei Xie, Chen Wei
Preprint (under review), 2026
website / paper
TL;DR. (Efficient LLM Reinforcement Learning) Showed that GRPO tolerates much staler rollouts than previously assumed when update instability is controlled. Reused rollouts in a few large generation and optimization stages, matching standard GRPO's reasoning performance at lower training cost.
|
|
MedTrinity-25M: A Large-scale Multimodal Dataset with Multigranular Annotations for Medicine
Yunfei Xie, Ce Zhou, Lang Gao, Juncheng Wu, Xianhang Li, Hong-Yu Zhou, Sheng Liu, Lei Xing, James Zou, Cihang Xie, Yuyin Zhou
ICLR 2025. (400+ GitHub stars)
website / paper
TL;DR. (Multimodal Data Curation) Built an automated grounding, annotation, and filtering multimodal data pipeline for medical pretraining, covering 25 million images across 10 modalities.
|
|
From Pixels to Objects: A Hierarchical Approach for Part and Object Segmentation Using Local and Global Aggregation
Yunfei Xie, Cihang Xie, Alan Yuille, Jieru Mei
ECCV 2024
paper
TL;DR. (Image Segmentation) Used local and global aggregation in a hierarchical vision transformer to improve part and object segmentation.
|
|
Story-Iter: A Training-free Iterative Paradigm for Long Story Visualization
Jiawei Mao, Xiaoke Huang, Yunfei Xie, Yuanqi Chang, Mude Hui, Bingjie Xu, Zeyu Zheng, Zirui Wang, Cihang Xie, Yuyin Zhou
ICLR 2026. (900+ GitHub stars)
website / paper / code
TL;DR. (Long-Context Image Generation) Improved consistency in long-story generation with a training-free method that refines story images using global reference context from the previous iteration.
|
Adobe Research |
May 2026 - Aug. 2026: Research Intern, Adobe Research
Advisor: Dr. Branislav Kveton
RL for Flow Matching: Developed a reinforcement learning algorithm for post-training flow-matching generative models, applied to Adobe’s Firefly foundation model. |
|
Feb. 2025 - Present: Research Assistant, Rice University
Advisor: Prof. Chen Wei; robot learning in collaboration with Prof. Kaiyu Hang’s RobotPI Lab
Focus: Human-video learning and offline robot-model evaluation (RoboTok, S²), RL post-training (Play to Generalize, µ-GRPO), and self-improving agents (MEMO). |
|
Dec. 2023 - Feb. 2025: Research Intern, VLAA Lab, University of California, Santa Cruz
Advisors: Prof. Yuyin Zhou and Prof. Cihang Xie
Focus: Multimodal data synthesis and annotation (MedTrinity-25M), and long-story visualization (Story-Iter). |
|
Jul. 2023 - Dec. 2023: Research Intern, CCVL Lab, Johns Hopkins University
Advisors: Prof. Alan Yuille and Dr. Jieru Mei
Focus: Hierarchical vision transformers for part and object segmentation (From Pixels to Objects). |
Honors and Awards
- Aug. 2025: Lambda Research Grant ($10,000)
- 2022: Science and Technology Scholarship, Huazhong University of Science and Technology (top 2% in school)
Invited Talks
Dec. 2025: “Play to Generalize: Learning to Reason Through Game Play,” Open AGI Symposium, NeurIPS 2025.
|
2026: ICLR, ICML, CVPR, ECCV
2025: ICCV, ICLR, CVPR, ICML, TMM, NeurIPS, TPAMI
2024: CVPR, ICML, IEEE ISBI
|
This website template was borrowed from Jon Barron.
Last updated on October 6, 2026.
|
|