profile photo

| | |

Sihyun Yu

I am a postdoctoral researcher at KAIST. I also work closely with Saining Xie. I received my PhD from KAIST, advised by Jinwoo Shin. During my PhD, I was a visiting scholar at NYU Courant and interned at Google Research and NVIDIA Research.

My research focuses on visual artificial intelligence: models that understand complex visual worlds and can reason, plan, and imagine future states. I am also interested in AI4Science and have contributed to several related projects.

News
Jan 2026: DMF and MELD are accepted to ICLR 2026.
Oct 2025: Joined NYU as a visiting scholar for 5 months!
Jul 2025: Successfully defended my PhD thesis!
Jun 2025: I am attending CVPR in person. See you in Nashville!
Apr 2025: I received Google Conference Scholarships (APAC).
Apr 2025: I am attending ICLR in person. See you in Singapore!
Mar 2025: I gave a talk at Sheffield NLP.
Feb 2025: BootComp and CoordTok are accepted to CVPR 2025.
Publications  
Selected
All

World Action Models are Zero-Shot Policies
Seonghyeon Ye**, Yunhao Ge*, Kaiyuan Zheng*, Shenyuan Gao*, Sihyun Yu*, George Kurian*, Suneel Indupuru*, You Liang Tan*, Chuning Zhu, Jiannan Xiang, Ayaan Malik, Kyungmin Lee, William Liang, Nadun Ranawaka, Jiasheng Gu, Yinzhen Xu, Guanzhi Wang, Fengyuan Hu, Avnish Narayan, Johan Bjorck, Jing Wang, Gwanghyun Kim, Dantong Niu, Ruijie Zheng, Yuqi Xie, Jimmy Wu, Qi Wang, Ryan Julian, Danfei Xu, Yilun Du, Yevgen Chebotar, Scott Reed, Jan Kautz, Yuke Zhu**, Jim Fan**, Joel Jang**
Technical report.
paper  |  project page  |  code (★: )

DreamDojo: A Generalist Robot World Model from Large-Scale Human Videos
Shenyuan Gao**, William Liang**, Kaiyuan Zheng*, Ayaan Malik*, Seonghyeon Ye, Sihyun Yu, Wei-Cheng Tseng, Yuzhu Dong, Kaichun Mo, Chen-Hsuan Lin, Qianli Ma, Seungjun Nah, Loic Magne, Jiannan Xiang, Yuqi Xie, Ruijie Zheng, Dantong Niu, You Liang Tan, KR Zentner, George Kurian, Suneel Indupuru, Pooya Jannaty, Jinwei Gu, Jun Zhang, Jitendra Malik, Pieter Abbeel, Ming-Yu Liu, Yuke Zhu***, Joel Jang***, Jim Fan***
Technical report.
paper  |  project page  |  code (★: )

Enhancing Motion Dynamics of Image-to-Video Models via Adaptive Low-Pass Guidance
June Suk Choi, Kyungmin Lee, Sihyun Yu, Yisol Choi, Jinwoo Shin, Kimin Lee
CVPR 2026
paper  |  project page  |  code (★: )

Decoupled MeanFlow: Turning Flow Models into Flow Maps for Accelerated Sampling
Kyungmin Lee, Sihyun Yu, Jinwoo Shin
ICLR 2026
paper  |  code (★: )

Learning Flexible Forward Trajectories for Masked Molecular Diffusion
Hyunjin Seo*, Taewon Kim*, Sihyun Yu, Sungsoo Ahn
ICLR 2026
paper  |  project page

ContextVLA: Vision-Language-Action Model with Amortized Multi-Frame Context
Huiwon Jang, Sihyun Yu, Heeseung Kwon, Hojin Jeon, Younggyo Seo, Jinwoo Shin
preprint.
paper  |  project page  |  code (★: )

Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Think
Sihyun Yu, Sangkyung Kwak, Huiwon Jang, Jongheon Jeong, Jonathan Huang, Jinwoo Shin, Saining Xie
ICLR 2025
Oral Presentation (213/11672=1.82%)
paper  |  project page  |  code (★: )

MALT Diffusion: Memory-Augmented Latent Transformers for Any-Length Video Generation
Sihyun Yu, Meera Hahn, Dan Kondratyuk, Jinwoo Shin, Agrim Gupta, José Lezama, Irfan Essa, David Ross, Jonathan Huang
CVPR 2025 Workshop on AI for Content Creation
Oral Presentation
paper

Controllable Human Image Generation with Personalized Multi-Garments
Yisol Choi, Sangkyung Kwak, Sihyun Yu, Hyungwon Choi, Jinwoo Shin
CVPR 2025
paper  |  project page  |  code (★: )

Efficient Long Video Tokenization via Coordinate-based Patch Reconstruction
Huiwon Jang, Sihyun Yu, Jinwoo Shin, Pieter Abbeel, Younggyo Seo
CVPR 2025
paper  |  project page  |  code (★: )

MC2: Multi-view Consistent Depth Estimation via Coordinated Image-based Neural Rendering
Subin Kim, Seong Hyeon Park, Sihyun Yu, Kihyuk Sohn, Jinwoo Shin
CVPR 2024 Workshop on Neural Rendering Intelligence
paper  |  project page

Data-Efficient Molecular Generation with Hierarchical Textual Inversion
Seojin Kim, Jaehyun Nam, Sihyun Yu, Younghoon Shin, Jinwoo Shin
ICML 2024
paper  |  code (★: )

Efficient Video Diffusion Models via Content-Frame Motion-Latent Decomposition
Sihyun Yu, Weili Nie, De-An Huang, Boyi Li, Jinwoo Shin, Anima Anandkumar
ICLR 2024
paper  |  project page  |  code (★: )

Learning Large-scale Neural Fields via Context Pruned Meta-Learning
Jihoon Tack, Subin Kim, Sihyun Yu, Jaeho Lee, Jinwoo Shin, Jonathan Richard Schwarz
NeurIPS 2023
paper  |  code (★: )

Video Probabilistic Diffusion Models in Projected Latent Space
Sihyun Yu, Kihyuk Sohn, Subin Kim, Jinwoo Shin
CVPR 2023
paper  |  project page  |  code (★: )

Enhancing Multiple Reliability Measures via Nuisance-extended Information Bottleneck
Jongheon Jeong, Sihyun Yu, Hankook Lee, Jinwoo Shin
CVPR 2023
paper  |  code (★: )

Scalable Neural Video Representations with Learnable Positional Features
Subin Kim*, Sihyun Yu*, Jaeho Lee, Jinwoo Shin
NeurIPS 2022
paper  |  project page  |  code (★: )

Generating Videos with Dynamics-aware Implicit Generative Adversarial Networks
Sihyun Yu*, Jihoon Tack*, Sangwoo Mo*, Hyunsu Kim, Junho Kim, Jung-Woo Ha, Jinwoo Shin
ICLR 2022
paper  |  project page  |  code (★: )

Consistency Regularization for Adversarial Robustness
Jihoon Tack, Sihyun Yu, Jongheon Jeong, Minseon Kim, Sung Ju Hwang, Jinwoo Shin
AAAI 2022
paper  |  code (★: )

RoMA: Robust Model Adaptation for Offline Model-based Optimization
Sihyun Yu, Sungsoo Ahn, Le Song, Jinwoo Shin
NeurIPS 2021
paper  |  code (★: )

Abstract Reasoning via Logic-guided Generation
Sihyun Yu, Sangwoo Mo, Sungsoo Ahn, Jinwoo Shin
ICML 2021 Workshop on Self-Supervised Learning for Reasoning and Perception
Oral Presentation
paper  |  poster

Work Experience

NYU Courant
Visiting Scholar (host: Saining Xie)
Oct 2025 - Feb 2026, New York, NY

Google Research
Student Researcher (host: Jonathan Huang)
Oct 2023 - Apr 2024, Kirkland, WA

NVIDIA Research
Research Intern (mentors: Weili Nie, De-An Huang, Boyi Li, and Anima Anandkumar)
Mar 2023 - Sep 2023, Santa Clara, CA (remote)

Google Research
University Relation Program (host: Kihyuk Sohn)
Jul 2022 - Jan 2023, Bay Area, CA (remote)

Honors and Awards

Recipient, ICLR 2025 Google Conference Scholarships (APAC)
Winner, Qualcomm Innovation Fellowship Korea 2023
Recipient, CVPR 2023 Travel Awards
Recipient, CVPR 2023 Google Conference Scholarships (APAC)
Top Reviewer, NeurIPS 2022
Best Paper Awards, Korean Artificial Intelligence Association, 2021
Recipient, KAIST Presidental Fellowship
Recipient, 2019 Qualcomm-KAIST Innovation Awards
Recipient, National Presidental Scholarship for Science
Recipient, Hansung Scholarship for Gifted Students

Invited Talks

MALT Diffusion: Memory-Augmented Latent Transformers for Any-Length Video Generation
Jun 2025; CVPR 2025 Workshop on AI for Content Creation (Nashville, TN)

Training Diffusion Transformers Is Easier Than You Think
Nov 2025; Keynote Talk at the ELLIS UniReps (Remote)
Apr 2025; ICLR 2025 Oral Session (Singapore)
Mar 2025; Sheffield NLP Group (Remote)
Feb 2025; KAIST Graduate School of AI (Seoul, South Korea)
Feb 2025; Korea AI Frontier Lab (Seoul, South Korea)
Dec 2024; Sungsoo Ahn's Group @ KAIST (Seoul, South Korea)
Oct 2024; BioImaging, Signal Processing & Learning Lab @ KAIST (Seoul, South Korea)

Efficient Latent Video Diffusion Models via Triplane Encoding
Nov 2023; Google Research (Kirkland, WA)

Video Probabilistic Diffusion Models in Projected Latent Space
Jun 2023; Innerverz (remote)

Efficient Generative Models for Videos
Mar 2023; LG AI Research (Seoul, South Korea)

RoMA: Robust Model Adaptation for Offline Model-based Optimization
Jun 2022; Samsung Electronics (Suwon, South Korea)

Scaling Video Generation via Implicit Neural Representations
Jun 2022; Pohang University of Science and Technology (Pohang, South Korea)

Abstract Reasoning via Logic-guided Generation
Jun 2021; ICML Workshop on Self-Supervised Learning for Reasoning and Perception 2021 (remote)

Academic Services

Conference reviewer: ICML'22-25, NeurIPS'22-25, ICLR'23-26, CVPR'23-26, ICCV'23-25, ECCV'24, WACV'25, AAAI'25, AISTATS'26
Journal reviewer: TPAMI, TMLR
Workshop organizer: INR-V@CVPR'24

Teaching

Teaching Assistant, Deep Learning, Fall 2020
Teaching Assistant, Samsung Electronics AI-Expert Program, Summer 2020
Peer Tutor, System Programming, Spring 2019
Teaching Assistant, Linear Algebra, Spring 2019
Teaching Assistant, Calculus 1, Spring 2018