Dr. Lei Sun

Research Scientist
Email: leo_sun[at]zju[dot]edu[dot]cn; lei[dot]sun[at]insait[dot]ai


About me

My research interests include multi-modal fusion, image restoration, event-based algorithms, image/video generative models, and semantic segmentation.

I am interested in event cameras, a neuromorphic sensor that imitates the behavior of the human eye. Check out the introduction of the event camera and one of my project pages

I am also doing research on multi-modal fusion and  image/video generative models.

Before joining INSAIT, I led projects aimed at improving smartphone camera image processing pipelines in collaboration with several smartphone camera brands.

Education

  • University of Zurich & ETH Zurich, Robotics & Perception Group, Jan 2023 – Aug 2023
    Visiting Ph.D. student, Supervisor: Davide Scaramuzza
  • ETH Zurich, Computer Vision Lab, Sep 2021 – Jan 2023
    Visiting Ph.D. student, Supervisor: Luc Van Gool
  • Zhejiang University, Sep 2018 – Jul 2024
    Ph.D. in Computer Vision, Supervisor: Kaiwei Wang
  • Beijing Institution of Technology, Sep 2014 – Jun 2018
    B.Sc. in Optical Engineering

For a complete list of my publications, please see my Google Scholar page.

2026

Weilun Li, Lei Sun, Ruixi Gao, Qi Jiang, Yuqin Ma, Kaiwei Wang, Ming-Hsuan Yang, Luc Van Gool, Danda Pani Paudel
EvDiff: Event-Based Video Reconstruction using One-Step Diffusion Models
In: In: European Conference on Computer Vision (ECCV 2026)

Dannong Xu, Zhongyu Yang, Jun Chen, Yingfang Yuan, Ming Hu, Lei Sun, Luc Van Gool, Danda Pani Paudel, Chun-Mei Feng

MultiHaystack: Benchmarking Multimodal Retrieval and Reasoning over 40K Images, Videos, and Documents
In: European Conference on Computer Vision (ECCV 2026)

Jingyun Liang, Jingkai Zhou, Shikai Li, Chenjie Cao, Lei Sun, Yichen Qian, Weihua Chen, Fan Wang
RealisMotion: Decomposed Human Motion Control and Video Generation in the World Space
In: Forty-Third International Conference on Machine Learning (ICML 2026)

Xiaolong Qian, Qi Jiang, Lei Sun,  Zongxi Yu, Kailun Yang, Peixuan Wu, Jiacheng Zhou, Yao Gao,  Yaoguang Ma, Ming-Hsuan Yang, Kaiwei Wang
Learning Latent Transmission and Glare Maps for Lens Veiling Glare Removal
In: The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2026)

Shaolin Su, Josep M. Rocafort, David Serrano-Lozano, Lei Sun, Danna Xue, Javier Vazquez-Corral
Bridging the Perception Gap in Image Super-Resolution Evaluation
In: The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2026)

 

Xiaolong Qian,  Qi Jiang, Yao Gao,  Lei Sun, Zhonghua Yi, Kailun Yang, Luc Van Gool, Kaiwei Wang
Towards Universal Computational Aberration Correction in Photographic Cameras: A Comprehensive Benchmark Analysis
In: The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2026)

2025

Lei Sun, Hang Guo, Bin Ren, Luc Van Gool, Radu Timofte, Yawei Li
The Tenth NTIRE 2025 Image Denoising Challenge Report
In: Conference on Computer Vision and Pattern Recognition (CVPR 2025) (Workshop)

Lei Sun, Yuhan Bao, Jiajun Zhai, Jingyun Liang, Yulun Zhang, Kaiwei Wang, Danda Pani Paudel, Luc Van Gool
Low-Light Image Enhancement using Event-Based Illumination Estimation
In: International Conference on Computer Vision (ICCV 2025)

2024

Lei Sun; Daniel Gehrig; Christos Sakaridis; Mathias Gehrig; Jingyun Liang, Peng Sun, Zhijie Xu, Kaiwei Wang, Luc Van Gool
A Unified Framework for Event-Based Frame Interpolation With Ad-Hoc Deblurring in the Wild
In: IEEE Transactions on Pattern Analysis and Machine Intelligence