Dr. Danda Paudel

My research focuses on 3D Computer Vision, emphasising scene representation and understanding through spatial intelligence derived from 3D/4D visual data using vision-language models. Additionally, I am also interested in applying computer vision to Robotics and Augmented Reality. Some research topics I am currently working on are:

  • Real-time mapping and understanding of complex dynamic scenes
  • Robust spatial reasoning from multi-model and corrupted data
  • Transfer learning from 2D data and textual sources to 4D understanding
  • Vision-language models for task planning and Human-AI interaction
  • Geometrically consistent and physically plausible Visual Generative models


Google Scholar: link


Academic carrier:

Recognitions:

Publications:

  1. Reni Paskaleva, Mykyta Holubakha, Andela Ilic, Saman Motamed, Luc Van Gool, Danda Paudel.
    A Unified and Interpretable Emotion Representation and Expression Generation.
    In: Computer Vision and Pattern Recognition Conference (CVPR), 2024.
  2. Zongwei Wu, Jilai Zheng, Xiangxuan Ren, Florin-Alexandru Vasluianu, Chao Ma, Danda Paudel, Luc Van Gool, Radu Timofte.
    Single-Model and Any-Modality for Video Object Tracking.
    In: Computer Vision and Pattern Recognition Conference (CVPR), 2024.
  3. Qi Ma, Danda Paudel, Ajad Chhatkuli, Luc Van Gool.
    Continuous Pose for Monocular Cameras in Neural Implicit Representation.
    In: Computer Vision and Pattern Recognition Conference (CVPR), 2024.
  4. Zhicheng Zhang, Junyao Hu, Wentao Cheng, Danda Paudel, Jufeng Yang.
    ExtDM: Dual Distribution Extrapolation Diffusion Model for Video Prediction.
    In: Computer Vision and Pattern Recognition Conference (CVPR), 2024.
  5. Nikola Popovic, Dimitrios Christodoulou, Danda Pani Paudel, Xi Wang, Luc Van Gool.
    Model-aware 3D Eye Gaze from Weak and Few-shot Supervisions.
    In: the International Symposium on Mixed and Augmented Reality (ISMAR), 2023.
  6. Nikola Popovic, Danda Pani Paudel, Thomas Probst, Luc Van Gool.
    Token-Consistent Dropout For Calibrated Vision Transformers.
    In: International Conference on Image Processing (ICIP), 2023.
  7. Zongwei Wu, Danda Pani Paudel, Deng-Ping Fan, Jingjing Wang, Shuo Wang, Cedric Demonceaux, Radu Timofte, Luc Van Gool.
    Source-free Depth for Object Pop-out.
    In: International Conference on Computer Vision (ICCV), 2023.
  8. Nikola Popovic, Danda Pani Paudel, Luc Van Gool.
    Surface Normal Clustering for Implicit Representation of Manhattan Scenes
    In: International Conference on Computer Vision (ICCV), 2023.
  9. Yigit Baran Can, Alexander Liniger, Danda Pani Paudel, Luc Van Gool.
    Improving Online Lane Graph Extraction by Object-Lane Clustering.
    In: International Conference on Computer Vision (ICCV), 2023.
  10. Qi Ma, Danda Pani Paudel, Ajad Chhatkuli, Luc Van Gool.
    Deformable Neural Radiance Fields using RGB and Event Cameras.
    In: International Conference on Computer Vision (ICCV), 2023.

2026

Carmelo ScribanoMohammad MahdiNedyalko PrisadnikovYuqian Fu, Giorgia Franchini, Danda Pani Paudel, Marko Bertogna, Luc Van Gool
Accelerating Vision Foundation Models with Drop-in Depthwise Convolution
In: International Conference on Pattern Recognition (ICPR 2026)

Yebin Yang, Di Wen, Lei Qi, Weitong Kong, Junwei Zheng, Ruiping Liu, Yufan Chen, Chengzhi Wu, Kailun Yang, Yuqian Fu, Danda Pani Paudel, Luc Van Gool, Kunyu PengInterEdit: Navigating Text-Guided Multi-Human 3D Motion EditingIn: European Conference on Computer Vision (ECCV 2026)

Nedyalko Prisadnikov, Danda Pani Paudel, Yuqian Fu, Luc Van Gool
SOVA: Image size agnostic and task driven vision encoder
In: Forty-Third International Conference on Machine Learning (ICML 2026)

Zihao Dongfang, Xu Zheng, Ziqiao Weng, Yuanhuiyi Lyu, Danda Pani Paudel, Luc Van Gool, Kailun Yang, Xuming Hu
Are Multimodal Large Language Models Ready for Omnidirectional Spatial Reasoning?
In: The Findings track of IEEE/CVF Conference on Computer Vision and Pattern Recognition 2026 (CVPR 2026 Findings)

Bingwen Zhu, Bingwen_Zhu, Yuqian Fu, Qiaole Dong, Guolei Sun, Tianwen Qian, Yuzheng Wu, Danda Pani Paudel, Yanwei Fu, Xiangyang Xue
EgoSound: Benchmarking Sound Understanding in Egocentric Videos
In: The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2026)

Liming Kuang, Dani Velikova, Mahdi Saleh, Jan-Nico Zaech, Danda Pani Paudel, Benjamin Busam
ConceptPose: Training-Free Zero-Shot Object Pose Estimation using Concept Vectors
In: The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2026)

Jiancheng Pan, Runze Wang, Tianwen Qian, Mohammad Mahdi, Yanwei Fu, Xiangyang Xue, Xiaomeng Huang, Luc Van Gool, Danda Pani Paudel, Yuqian Fu
V^{2}-SAM: Marrying SAM2 with Multi-Prompt Experts for Cross-View Object Correspondence
In: The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2026)

Mario Markov, Stefan Maria Ailuro, Luc Van Gool, Konrad Schindler, Danda Pani Paudel
FireScope: Wildfire Risk Raster Prediction With a Chain-of-Thought Oracle
In: The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2026)

Yue Li, Qi Ma, Runyi Yang, Mengjiao Ma, Bin Ren, Nikola Popovic, Nicu Sebe, Theo Gevers, Luc Van Gool, Danda Pani Paudel, Martin R. Oswald
Chorus: Multi-Teacher Pretraining for Holistic 3D Gaussian Scene Encoding
In: The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2026)

Bin Ren, Yawei Li, Xu Zheng, Yuqian Fu, Danda Pani Paudel, Hong Liu, Ming-Hsuan Yang, Luc Van Gool, Nicu Sebe
Efficient Degradation-agnostic Image Restoration via Channel-Wise Functional Decomposition and Manifold Regularization
In: The Fourteenth International Conference on Learning Representations (ICLR 2026)

Bin Ren, Runyi Yang, Qi Ma, Xu Zheng, Mengyuan Liu, Danda Pani Paudel, Luc Van Gool, Rita Cucchiara, Nicu Sebe
Rethinking Expressivity and Degradation-Awareness in Attention for All-in-One Blind Image Restoration
In: The Fourteenth International Conference on Learning Representations (ICLR 2026)

Deheng Zhang, Yuqian Fu, Runyi Yang, Yang Miao, Tianwen Qian, Xu Zheng, Guolei Sun, Ajad Chhatkuli, Xuanjing Huang, Yu-Gang Jiang, Luc Van Gool, Danda Pani Paudel
EgoNight: Towards Egocentric Vision Understanding at Night with a Challenging Benchmark
In: The Fourteenth International Conference on Learning Representations (ICLR 2026)

Asen Nachkov, Danda Pani Paudel Jan-Nico Zaech, Davide Scaramuzza, Luc Van Gool
Unlocking Efficient Vehicle Dynamics Modeling via Analytic World Models
In: The 40th Annual AAAI Conference on Artificial Intelligence (AAAI 2026)

2025

Asen Nachkov, Danda Pani Paudel, Luc Van Gool
Autonomous Vehicle Controllers From End-to-End Differentiable Simulation
In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2025)

Asen Nachkov; Danda Pani Paudel; Martin Danelljan; Luc Van Gool
Diffusion-Based Particle-DETR for BEV Perception
In: Winter Conference on Applications of Computer Vision (WACV 2025)

Chenfei Liao, Kaiyu Lei, Xu Zheng, Junha Moon, Zhixiong Wang, Yixuan Wang, Danda Pani Paudel, Luc Van Gool, Xuming Hu
Benchmarking Multi-modal Semantic Segmentation under Sensor Failures: Missing and Noisy Modality Robustness
In: Conference on Computer Vision and Pattern Recognition (CVPR 2025) (Workshop)

Qi Ma, Yue Li, Bin Ren, Nicu Sebe, Ender Konukoglu, Theo Gevers, Luc Van Gool, Danda Pani Paudel
A Large-Scale Dataset of Gaussian Splats and Their Self-Supervised Pretraining
In: International Conference on 3D Vision (3DV 2025)

Jiancheng Pan, Yanxing Liu, Yuqian Fu, Muyuan Ma, Jiahao Li, Danda Pani Paudel, Luc Van Gool, Xiaomeng Huang
Locate Anything on Earth: Advancing Open-Vocabulary Object Detection for Remote Sensing Community
In: AAAI Conference on Artificial Intelligence (AAAI 2025)

M. Eren Akbiyik, Nedko Savov, Danda Pani Paudel, Nikola Popovic, Christian Vater, Otmar Hilliges, Luc Van Gool, Xi Wang
Leveraging Driver Field-of-View for Multimodal Ego-Trajectory Prediction
In: The International Conference on Learning Representations (ICLR 2025)

Nedko Savov, Naser Kazemi, Mohammad Mahdi, Danda Pani Paudel, Xi Wang, Luc Van Gool
Exploration-Driven Generative Interactive Environments
In: The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2025)

Eduard Zamfir, Zongwei Wu, Nancy Mehta, Yuedong Tan, Danda Pani Paudel, Yulun Zhang, Radu Timofte
Complexity Experts are Task-Discriminative Learners for Any Image Restoration
In: The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2025)

Sombit Dey, Jan-Nico Zaech, Nikolay Nikolov, Luc Van Gool, Danda Pani Paudel
ReVLA: Reverting Visual Domain Limitation of Robotic Foundation Models
In: International Conference on Robotics and Automation (ICRA 2025)

Yuedong Tan, Zongwei Wu, Yuqian Fu, Zhuyun Zhou, Guolei Sun, Eduard Zamfi, Chao Ma, Danda Pani Paudel, Luc Van Gool, Radu Timofte
XTrack: Multimodal Training Boosts RGB-X Video Object Trackers
In: International Conference on Computer Vision (ICCV 2025)

Yuqian Fu, Runze Wang, Yanwei Fu, Danda Pani Paudel, Xuanjing Huang, Luc Van Gool
ObjectRelator: Enabling Cross-View Object Relation Understanding in Ego-Centric and Exo-Centric Videos
In: International Conference on Computer Vision (ICCV 2025)

Xu Zheng, Yuanhuiyi Lyu, Lutao Jiang, Danda Pani Paudel, Luc Van Gool, Xuming Hu
Reducing Unimodal Bias in Multi-Modal Semantic Segmentation with Multi-Scale Functional Entropy Regularization
In: International Conference on Computer Vision (ICCV 2025)

Lei Sun, Yuhan Bao, Jiajun Zhai, Jingyun Liang, Yulun Zhang, Kaiwei Wang, Danda Pani Paudel, Luc Van Gool
Low-Light Image Enhancement using Event-Based Illumination Estimation
In: International Conference on Computer Vision (ICCV 2025)

Yuedong Tan, Jiawei Shao, Eduard Zamfir, Ruanjun Li, Zhaochong An, Chao Ma, Danda Pani Paudel, Luc Van Gool, Radu Timofte, Zongwei Wu
What You Have is What You Track: Adaptive and Robust Multimodal Tracking
In: International Conference on Computer Vision (ICCV 2025)

Yue Li, Qi Ma, Runyi Yang, Huapeng Li, Mengjiao Ma, Bin Ren, Nikola Popovic, Nicu Sebe, Ender Konukoglu, Theo Gevers, Luc Van Gool, Martin R. Oswald, Danda Pani Paudel
SceneSplat: Gaussian Splatting-based Scene Understanding with Vision-Language Pretraining
In: International Conference on Computer Vision (ICCV 2025)

Ada-Astrid Balauca, Sanjana Garai, Stefan Balauca, Rasesh Udayakumar Shetty, Naitik Agrawal, Dhwanil Subhashbhai Shah, Yuqian Fu, Xi Wang, Kristina Toutanova, Danda Pani Paudel, Luc Van Gool
Understanding Museum Exhibits using Vision-Language Reasoning
In: International Conference on Computer Vision (ICCV 2025)

Jialei Chen, Xu Zheng, Dongyue Li, Chong Yi, Seigo Ito, Danda Pani Paudel, Luc Van Gool, Hiroshi Murase, Daisuke Deguchi
Split Matching for Inductive Zero-shot Semantic Segmentation
In: The British Machine Vision Conference (BMVC 2025)

Jiahuan Cheng, Jan-Nico Zaech, Luc Van Gool, Danda Pani Paudel
Occam’s LGS: An Efficient Approach for Language Gaussian Splatting
In: The British Machine Vision Conference (BMVC 2025)

Alexander Spiridonov, Jan-Nico Zaech, Nikolay Nikolov, Luc Van Gool, Danda Pani Paudel
Generalist Robot Manipulation beyond Action Labeled Data
In: The Conference on Robot Learning (CoRL 2025)

Nedko Savov, Naser Kazemi, Deheng Zhang, Danda Pani Paudel, Xi Wang, Luc Van Gool
StateSpaceDiffuser: Bringing Long Context to Diffusion World Models
In: The Thirty-Ninth Annual Conference on Neural Information Processing Systems (NeurIPS 2025)

Yu Li, Xingyu Qiu, Yuqian Fu, Jie Chen, Tianwen Qian, Xu Zheng, Danda Pani Paudel, Yanwei Fu, Xuanjing Huang, Luc Van Gool, Yu-Gang Jiang
Domain-RAG: Retrieval-Guided Compositional Image Generation for Cross-Domain Few-Shot Object Detection
In: The Thirty-Ninth Annual Conference on Neural Information Processing Systems (NeurIPS 2025)

Yang Miao, Jan-Nico Zaech, Xi Wang, Fabien Despinoy, Danda Pani Paudel, Luc Van Gool
LangHOPS: Language Grounded Hierarchical Open-Vocabulary Part Segmentation
In: The Thirty-Ninth Annual Conference on Neural Information Processing Systems (NeurIPS 2025)

Mengjiao Ma, Qi Ma, Yue Li, Jiahuan Cheng, Runyi Yang, Bin Ren, Nikola Popovic, Mingqiang Wei, Nicu Sebe, Ender Konukoglu, Luc Van Gool, Theo Gevers, Martin R. Oswald, Danda Pani Paudel
SceneSplat++: A Large Dataset and Comprehensive Benchmark for Language Gaussian Splatting
In: NeurIPS 2025 (Dataset and benchmark track)

Asen Nachkov, Danda Pani Paudel, Luc Van Gool
Autonomous Vehicle Controllers From End-to-End Differentiable Simulation
In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2025)

2024

Zhuyun Zhou, Zongwei Wu; Danda Pani Paudel; Rémi Boutteau; Fan Yang; Luc Van Gool
Event-Free Moving Object Segmentation from Moving Ego Vehicle
In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2024)

Junru Lin; Asen Nachkov; Songyou Peng; Luc Van Gool; Danda Pani Paudel
Ternary-Type Opacity and Hybrid Odometry for RGB NeRF-SLAM
In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2024)

Bin Ren, Guofeng Mei, Danda Pani Paudel, Weijie Wang, Yawei Li, Mengyuan Liu, Rita Cucchiara, Luc Van Gool & Nicu Sebe
Bringing Masked Autoencoders Explicit Contrastive Properties for Point Cloud Self-supervised Learning
In: Asian Conference on Computer Vision (ACCV 2024)

Reni Paskaleva, Mykyta Holubakha, Andela Ilic, Saman Motamed, Luc Van Gool, Danda Paudel
A Unified and Interpretable Emotion Representation and Expression Generation.
In: Computer Vision and Pattern Recognition Conference (CVPR 2024)

Zongwei Wu, Jilai Zheng, Xiangxuan Ren, Florin-Alexandru Vasluianu, Chao Ma, Danda Paudel, Luc Van Gool, Radu Timofte
Single-Model and Any-Modality for Video Object Tracking
In: Computer Vision and Pattern Recognition Conference (CVPR 2024)

Qi Ma, Danda Paudel, Ajad Chhatkuli, Luc Van Gool
Continuous Pose for Monocular Cameras in Neural Implicit Representation
In: Computer Vision and Pattern Recognition Conference (CVPR 2024)

Zhicheng Zhang, Junyao Hu, Wentao Cheng, Danda Paudel, Jufeng Yang
ExtDM: Dual Distribution Extrapolation Diffusion Model for Video Prediction
In: Computer Vision and Pattern Recognition Conference (CVPR 2024)

Junru Lin, Asen Nachkov, Songyou Peng, Luc Van Gool, Danda Pani Paudel
Ternary-type Opacity and Hybrid Odometry for RGB-only NeRF-SLAM
In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2024)

Ada-Astrid Balauca, Danda Pani Paudel, Kristina Toutanova, Luc Van Gool
Taming CLIP for Fine-grained and Structured Visual Understanding of Museum Exhibits
In: The European Conference on Computer Vision (ECCV 2024)

Qi Ma, Danda Pani Paudel, Ender Konukoglu, Luc Van Gool
Implicit-Zoo: A Large-Scale Dataset of Neural Implicit Functions for 2D Images and 3D Scenes
In: Conference on Neural Information Processing Systems (NeurIPS 2024)

Naser Kazemi, Nedko Savov, Danda Paudel, Luc Van Gool
Learning Generative Interactive Environments By Trained Agent Exploration
In: Conference on Neural Information Processing Systems (NeurIPS 2024) (Workshop)