Research Scientist
Email: leo_sun[at]zju[dot]edu[dot]cn; lei[dot]sun[at]insait[dot]ai
About me
Dr. Lei Sun
My research interests include multi-modal fusion, image restoration, event-based algorithms, image/video generative models, and semantic segmentation.
I am interested in event cameras, a neuromorphic sensor that imitates the behavior of the human eye. Check out the introduction of the event camera and one of my project pages.
I am also doing research on multi-modal fusion and image/video generative models.
Before joining INSAIT, I led projects aimed at improving smartphone camera image processing pipelines in collaboration with several smartphone camera brands.
Education
- University of Zurich & ETH Zurich, Robotics & Perception Group, Jan 2023 – Aug 2023
Visiting Ph.D. student, Supervisor: Davide Scaramuzza - ETH Zurich, Computer Vision Lab, Sep 2021 – Jan 2023
Visiting Ph.D. student, Supervisor: Luc Van Gool - Zhejiang University, Sep 2018 – Jul 2024
Ph.D. in Computer Vision, Supervisor: Kaiwei Wang - Beijing Institution of Technology, Sep 2014 – Jun 2018
B.Sc. in Optical Engineering
For a complete list of my publications, please see my Google Scholar page.
2026
Zhendong Li, Lei Sun, Ruibo Ming, He Zhang, Danda Pani Paudel, Luc Van Gool, and Jinjin Gu
Knowledge-Centric Agents for Workflow Generation in ComfyUI
In: European Conference on Computer Vision (ECCV 2026)
Weilun Li, Lei Sun, Ruixi Gao, Qi Jiang, Yuqin Ma, Kaiwei Wang, Ming-Hsuan Yang, Luc Van Gool, Danda Pani Paudel
EvDiff: Event-Based Video Reconstruction using One-Step Diffusion Models
In: In: European Conference on Computer Vision (ECCV 2026)
Dannong Xu, Zhongyu Yang, Jun Chen, Yingfang Yuan, Ming Hu, Lei Sun, Luc Van Gool, Danda Pani Paudel, Chun-Mei Feng
MultiHaystack: Benchmarking Multimodal Retrieval and Reasoning over 40K Images, Videos, and Documents
In: European Conference on Computer Vision (ECCV 2026)
Jingyun Liang, Jingkai Zhou, Shikai Li, Chenjie Cao, Lei Sun, Yichen Qian, Weihua Chen, Fan Wang
RealisMotion: Decomposed Human Motion Control and Video Generation in the World Space
In: Forty-Third International Conference on Machine Learning (ICML 2026)
Xiaolong Qian, Qi Jiang, Lei Sun, Zongxi Yu, Kailun Yang, Peixuan Wu, Jiacheng Zhou, Yao Gao, Yaoguang Ma, Ming-Hsuan Yang, Kaiwei Wang
Learning Latent Transmission and Glare Maps for Lens Veiling Glare Removal
In: The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2026)
Shaolin Su, Josep M. Rocafort, David Serrano-Lozano, Lei Sun, Danna Xue, Javier Vazquez-Corral
Bridging the Perception Gap in Image Super-Resolution Evaluation
In: The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2026)
Xiaolong Qian, Qi Jiang, Yao Gao, Lei Sun, Zhonghua Yi, Kailun Yang, Luc Van Gool, Kaiwei Wang
Towards Universal Computational Aberration Correction in Photographic Cameras: A Comprehensive Benchmark Analysis
In: The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2026)
2025
Lei Sun, Hang Guo, Bin Ren, Luc Van Gool, Radu Timofte, Yawei Li
The Tenth NTIRE 2025 Image Denoising Challenge Report
In: Conference on Computer Vision and Pattern Recognition (CVPR 2025) (Workshop)
Lei Sun, Yuhan Bao, Jiajun Zhai, Jingyun Liang, Yulun Zhang, Kaiwei Wang, Danda Pani Paudel, Luc Van Gool
Low-Light Image Enhancement using Event-Based Illumination Estimation
In: International Conference on Computer Vision (ICCV 2025)
2024
Lei Sun; Daniel Gehrig; Christos Sakaridis; Mathias Gehrig; Jingyun Liang, Peng Sun, Zhijie Xu, Kaiwei Wang, Luc Van Gool
A Unified Framework for Event-Based Frame Interpolation With Ad-Hoc Deblurring in the Wild
In: IEEE Transactions on Pattern Analysis and Machine Intelligence