👋 Welcome!
I am currently a second-year Ph.D. student (2023 Fall) at the Hong Kong University of Science and Technology, Guangzhou, under the supervision of Prof. Ying-Cong Chen. Prior to this, I began my research journey as a Master’s student in 2020 at the MAC Lab of Xiamen University and received my Master’s degree in Artificial Intelligence in 2023, advised by the Prof. Rongrong Ji.
My research interests focus on visual generative models, particularly in exploring their versatility (Lotus), controllability (DisEnvisioner), and efficiency (PixelFolder). I am also interested in 3D vision and other AIGC tasks.
Feel free to contact me via e-mail if you are interested in discussing or collaborating with me. 😊
🔥 News
- 2025-01-23: 🎉🎉 Two papers are accepted by ICLR2025!
📝 Publications
LOTUS: Diffusion-based Visual Foundation Model for High-quality Dense Prediction
Jing He* , Haodong Li*, Wei Yin, Yixun Liang, Kaiqiang Zhou, Hongbo Zhang, Bingbing Liu, Ying-Cong Chen†
ICLR 2025
Paper / Project Page / Github 
DisEnvisioner: Disentangled and Enriched Visual Prompt for Image Customization
Jing He* , Haodong Li*,Yongzhe Hu, Guibao Shen, Yingjie Cai, Weichao Qiu, Ying-Cong Chen†
ICLR 2025
Paper / Project Page / Github 
OmniBooth: Learning Latent Control for Image Synthesis with Multi-modal Instruction
Leheng Li, Weichao Qiu, Xu Yan, Jing He, Kaiqiang Zhou, Yingjie Cai, Qing Lian, Bingbing Liu, Ying-Cong Chen†
arXiv 2024
arXiv / Project Page / Github / Model
Towards Efficient Diffusion-Based Image Editing with Instant Attention Masks
Siyu Zou, Jiji Tang, Yiyi Zhou, Jing He, Chaoyi Zhao, Rongsheng Zhang, Zhipeng Hu, Xiaoshuai Sun†
AAAI 2024
Paper / Github
PixelFolder: An efficient progressive pixel synthesis network for image generation
Jing He, Yiyi Zhou†, Qi Zhang, Jun Peng, Yunhang Shen, Xiaoshuai Sun, Chao Chen, Rongrong Ji
ECCV 2022
Paper / Github
Learning dynamic prior knowledge for text-to-face pixel synthesis
Jun Peng, Xiaoxiong Du, Yiyi Zhou, Jing He, Yunhang Shen, Xiaoshuai Sun, Rongrong Ji †
ACM MM 2022
Paper / Github
Towards open-ended text-to-face generation, combination and manipulation
Jun Peng, Han Pan, Yiyi Zhou, Jing He, Xiaoshuai Sun, Yan Wang, Yongjian Wu, Rongrong Ji †
ACM MM 2022
Paper / Github
💻 Internships
- 2021.08 - 2022.01, Tencent Youtu Lab, Shanghai, China.
📚 Services
Reviewer: ICLR2025, AAAI2024
📖 Educations
- 2023.09 - present, Ph.D. Student at AI Trust, The Hong Kong University of Science and Technology, GuangZhou. Advisor: Ying-Cong Chen.
- 2020.09 - 2023.06, Master of Engineering in Artificial Intelligence at the School of Information, Xiamen University. Advisor: Rongrong Ji.
- 2016.09 - 2020.06, Bachelor of Engineering in Digital Media Technology at the School of Computer Science and Technology, Wuhan Institute of Technology.
🎖 Honors and Awards
- 2023-2025 Postgraduate Scholarship, HKUST-GZ.
- 2020 Outstanding graduate student by WIT.
- 2016-2020 First-Class Scholarship by WIT.