Deqing Sun

Senior Staff Research Scientist, Google

Google Inc.
355 Main Street
Cambridge, MA 02142

Email / Bio / Twitter / LinkedIn / Scholar

Services

Program Chair for ICCV 2025

Guest editor for TPAMI special issue on Generative AI in 3D Vision

Area Chairs for ECCV (2018, 2022, 2024), ICLR 2024, NeurIPS 2023, ICCV 2023, CVPR (2019, 2020, 2022, 2023), BMVC (2019, 2020)

Co-organized Workshop/Tutorial on AI for Content Creation at SIGGRAPH 2018 and CVPR 2019-2023

Co-organized Workshop on What is Motion for? at ECCV 2022

Co-organized Workshop on What is Optical Flow for? at ECCV 2018

Guest editor for CVIU special issue on Deep Learning for Image Restoration

Reviewer for National Science Foundation (NSF)

Publications Google scholar profile

	Kyle Sargent, Zizhang Li, Tanmay Shah, Charles Herrmann, Hong-Xing Yu, Yunzhi Zhang, Eric Ryan Chan, Dmitry Lagun, Li Fei-Fei, Deqing Sun, Jiajun Wu. ZeroNVS: Zero-Shot 360-Degree View Synthesis from a Single Image. CVPR 2024. [pdf] [project page] [code]
	Xiaoyu Zhou, Zhiwei Lin, Xiaojun Shan, Yongtao Wang, Deqing Sun, Ming-Hsuan Yang. (equal contribution) DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenes.* CVPR 2024. [pdf] [project page] [code]
	Junyi Zhang, Charles Herrmann, Junhwa Hur, Eric Chen, Varun Jampani, Deqing Sun, Ming-Hsuan Yang. (equal contribution) Telling left from right: Identifying geometry-aware semantic correspondence.* CVPR 2024. [pdf] [project page] [code]
	Andreas Engelhardt, Amit Raj, Mark Boss, Yunzhi Zhang, Abhishek Kar, Yuanzhen Li, Deqing Sun, Ricardo Martin Brualla, Jonathan T Barron, Hendrik Lensch, Varun Jampani. SHINOBI: Shape and Illumination using Neural Object Decomposition via BRDF Optimization In-the-wild. CVPR 2024. [pdf] [project page]
	Mohamed El Banani, Amit Raj, Kevis-Kokitsi Maninis, Abhishek Kar, Yuanzhen Li, Michael Rubinstein, Deqing Sun, Leonidas Guibas, Justin Johnson, Varun Jampani. Probing the 3d awareness of visual foundation models. CVPR 2024. [pdf] [code]
	Hong-Xing Yu, Haoyi Duan, Junhwa Hur, Kyle Sargent, Michael Rubinstein, William T Freeman, Forrester Cole, Deqing Sun, Noah Snavely, Jiajun Wu, Charles Herrmann. Wonderjourney: Going from anywhere to everywhere. CVPR 2024. [pdf] [project page] [code]
	Gen Li, Deqing Sun, Laura Sevilla-Lara, Varun Jampani. One-Shot Open Affordance Learning with Foundation Models. CVPR 2024. [pdf] [project page] [code]
	Lei Zhong, Yiming Xie, Varun Jampani, Deqing Sun, Huaizu Jiang. SMooDi: Stylized Motion Diffusion Model. ECCV 2024. [pdf] [project page] [code]
	Zehao Zhu, Jiashun Wang, Yuzhe Qin, Deqing Sun, Varun Jampani, Xiaolong Wang. ContactArt: Learning 3d interaction priors for category-level articulated object and hand poses estimation. 3DV 2024. Oral presentation. [pdf] [project page]
	Omer Bar-Tal, Hila Chefer, Omer Tov, Charles Herrmann, Roni Paiss, Shiran Zada, Ariel Ephrat, Junhwa Hur, Yuanzhen Li, Tomer Michaeli, Oliver Wang, Deqing Sun, Tali Dekel, Inbar Mosseri. Lumiere: A space-time diffusion model for video generation. SIGGRAPH Asia 2024. [pdf] [project page]
	Xiaoyu Zhou, Xingjian Ran, Yajiao Xiong, Jinlin He, Zhiwei Lin, Yongtao Wang, Deqing Sun, Ming-Hsuan Yang. Gala3d: Towards text-to-3d complex scene generation via layout-guided generative gaussian splatting. ICML 2024. [pdf] [project page] [code]
	Xiaogang Peng, Yiming Xie, Zizhao Wu, Varun Jampani, Deqing Sun, Huaizu Jiang. Hoi-diff: Text-driven synthesis of 3d human-object interactions using diffusion models. ICLR 2024. [pdf] [project page] [code]
	Saurabh Saxena, Charles Herrmann, Junhwa Hur, Abhishek Kar, Mohammad Norouzi, Deqing Sun, David J Fleet. The Surprising Effectiveness of Diffusion Models for Optical Flow and Monocular Depth Estimation. NeurIPS 2023. Oral presentation. [pdf] [project page]
	Junyi Zhang, Charles Herrmann, Junhwa Hur, Luisa Polania Cabrera, Varun Jampani, Deqing Sun, Ming-Hsuan Yang. A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondence. NeurIPS 2023. [pdf] [project page (with code)]
	Xiaotong Wu, Wei-Sheng Lai, YiChang Shih, Charles Herrmann, Michael Krainin, Deqing Sun, Chia-Kai Liang. Efficient Hybrid Zoom using Camera Fusion on Mobile Phones. SIGGRAPH Asia 2023. [pdf] [project page]
	Kyle Sargent, Jing Yu Koh, Han Zhang, Huiwen Chang, Charles Herrmann, Pratul Srinivasan, Jiajun Wu, Deqing Sun. VQ3D: Learning a 3D-Aware Generative Model on ImageNet. ICCV 2023. Oral presentation. Best Paper Finalist. [pdf] [project page]
	Xiaoyu Zhou, Zhiwei Lin, Xiaojun Shan, Yongtao Wang, Deqing Sun, Ming-Hsuan Yang. SAMPLING: Scene-adaptive Hierarchical Multiplane Images Representation for Novel View Synthesis from a Single Image. ICCV 2023. [pdf] [project page]
	Hong-Xing Yu, Samir Agarwala, Charles Herrmann, Richard Szeliski, Noah Snavely, Jiajun Wu, Deqing Sun. Accidental Light Probes. CVPR 2023. [pdf] [project page (with code)]
	Gen Li, Varun Jampani, Deqing Sun, Laura Sevilla-Lara. LOCATE: Localize and Transfer Object Parts for Weakly Supervised Affordance Grounding. CVPR 2023. [pdf] [project page (with code)]
	Hsin-Ping Huang, Charles Herrmann, Junhwa Hur, Erika Lu, Kyle Sargent, Austin Stone, Ming-Hsuan Yang, Deqing Sun Self-supervised AutoFlow . CVPR 2023. [pdf]
	Mark Boss, Andreas Engelhardt, Abhishek Kar, Yuanzhen Li, Deqing Sun, Jonathan Barron, Hendrik Lensch, Varun Jampani SAMURAI: Shape And Material from Unconstrained Real-world Arbitrary Image collections NeurIPS 2022. [pdf] [project page (with code)]
	Hsin-Ping Huang, Deqing Sun, Yaojie Liu, Wen-Sheng Chu, Taihong Xiao, Jinwei Yuan, Hartwig Adam, Ming-Hsuan Yang Adaptive transformers for robust few-shot cross-domain face anti-spoofing. ECCV 2022. [pdf]
	Deqing Sun, Charles Herrmann, Fitsum Reda, Michael Rubinstein, David Fleet, William T Freeman Disentangling Architecture and Training for Optical Flow ECCV 2022. [pdf] [ code]
	Fitsum Reda, Janne Kontkanen, Eric Tabellion, Deqing Sun, Caroline Pantofaru, Brian Curless FILM: Frame Interpolation for Large Motion. ECCV 2022. [pdf] [code]
	Charles Herrmann, Kyle Sargent, Lu Jiang, Ramin Zabih, Huiwen Chang, Ce Liu, Dilip Krishnan, Deqing Sun (equal contribution) Pyramid Adversarial Training Improves ViT Performance*. CVPR 2022. Oral presentation. Best Paper Finalist. [pdf] [code]
	Klaus Greff, Francois Belletti, Lucas Beyer, Carl Doersch, Yilun Du, Daniel Duckworth, David J Fleet, Dan Gnanapragasam, Florian Golemo, Charles Herrmann, Thomas Kipf, Abhijit Kundu, Dmitry Lagun, Issam Laradji, Hsueh-Ti (Derek) Liu, Henning Meyer, Yishu Miao, Derek Nowrouzezahrai, Cengiz Oztireli, Etienne Pot, Noha Radwan, Daniel Rebain, Sara Sabour, Mehdi S. M. Sajjadi, Matan Sela, Vincent Sitzmann, Austin Stone, Deqing Sun, Suhani Vora, Ziyu Wang, Tianhao Wu, Kwang Moo Yi, Fangcheng Zhong, Andrea Tagliasacchi Kubric: A scalable dataset generator . CVPR 2022. [pdf] [code]
	Jinshan Pan, Deqing Sun, Jiawei Zhang, Jinhui Tang, Jian Yang, Yu-Wing Tai, Ming-Hsuan Yang Dual Convolutional Neural Networks for Low-Level Vision. IJCV, 2022. [pdf] [code]
	Wei-Sheng Lai, YiChang Shih, Lun-Cheng Chu, Xiaotong Wu, Sung-fang Tsai, Michael Krainin, Deqing Sun, Chia-Kai Liang Face Deblurring using Dual Camera Fusion on Mobile Phones. SIGGRAPH 2022. [Pixel 6 Launch]
	H. Song, D. Sun, S. Chun, V. Jampani, D. Han, B. Heo, W. Kim, and M-H Yang . ViDT: An Efficient and Effective Fully Transformer-based Object Detector. ICLR 2022. [pdf] [code]
	G. Yang, D. Sun, V. Jampani, D. Vlasic, F. Cole, C. Liu and D. Ramanan. ViSER: Video-Specific Surface Embeddings for Articulated 3D Shape Reconstruction. NeurIPS 2021. Spotlight presentation. [pdf] [webpage] [code]
	D. Sun, D. Vlasic, C. Herrmann, V. Jampani, M. Krainin, H. Chang, R. Zabih, W.T. Freeman and C. Liu. AutoFlow: Learning a Better Training Set for Optical Flow. CVPR 2021. Oral presentation. [pdf] [webpage] [data]
	G. Yang, D. Sun, V. Jampani, D. Vlasic, F. Cole, H. Chang, D. Ramanan, W.T. Freeman and C. Liu. LASR: Learning Articulated Shape Reconstruction from a Monocular Video. CVPR 2021. [pdf] [webpage] [code]
	F. Tan, D. Tang, M. Dou, K. Guo, R. Pandey, C. Keskin, R. Du, D. Sun, S. Bouaziz, S. Fanello, P. Tan and Y. Zhang. HumanGPS: Geodesic PreServing Feature for Dense Human Correspondences. CVPR 2021. [pdf] [webpage] [code]
	G. Li, V. Jampani, L. Sevilla-Lara, D.Sun, J. Kim and J. Kim. Adaptive Prototype Learning and Allocation for Few-Shot Segmentation . CVPR 2021. [pdf] [webpage] [code]
	T. Xiao, J. Yuan, D. Sun, Q. Wang, X. Zhang, K. Xu and M-H. Yang. Learnable Cost Volume Using the Cayley Representation . ECCV 2020. [pdf] [code]
	D. Sun, X. Yang, M-Y. Liu and J. Kautz. Models Matter, So Does Training: An Empirical Study of CNNs for Optical Flow Estimation . TPAMI, pp. 1408-1423, Vol. 42, Issue 6, 2020 [pdf] [code]
	H. Jiang, D. Sun, V. Jampani, Z. Lv, E. Learned-Miller and J. Kautz. SENSE: A Shared Encoder Network for Scene Flow Estimation. ICCV 2019. Oral presentation. [pdf] [code]
	F Reda, D Sun, A Dundar, M Shoeybi, G Liu, K. Shih, A. Tao, J. Kautz and B. Catanzaro. Unsupervised Video Interpolation Using Cycle Consistency. ICCV 2019. [pdf] [code]
	W-S. Lai, O. Gallo, J. Gu, D. Sun, M-H. Yang, and J. Kautz. Video Stitching for Linear Camera Arrays. BMVC 2019. [pdf]
	A. Ranjan, V. Jampani, L. Balles, K. Kim, D. Sun, J. Wulff and M. J. Black. Competitive Collaboration: Joint Unsupervised Learning of Depth, Camera Motion, Optical Flow and Motion Segmentation. CVPR 2019. [pdf] [code]
	H. Su, V. Jampani, D. Sun, O. Gallo, E. Learned-Miller and J. Kautz. Pixel-Adaptive Convolutional Neural Networks. CVPR 2019. [pdf] [webpage] [code]
	Z. Ren, O. Gallo, D. Sun, M-H Yang, E. B. Sudderth and J. Kautz. A Fusion Approach for Multi-Frame Optical Flow Estimation. IEEE Winter Conference on Applications of Computer Vision (WACV) 2019. [pdf] [code]
	V. Jampani, D. Sun, M-Y. Liu, M-H. Yang and J. Kautz. Superpixel Sampling Networks. ECCV 2018. [pdf] [webpage] [code]
	X. Xu, D. Sun, S. Liu, W. Ren, Y. Zhang, M-H. Yang and J. Sun. Rendering Portraitures from Monocular Camera and Beyond . ECCV 2018. [pdf]
	J. Dong, J. Pan, D. Sun, Z. Su and MH Yang. Learning Data Terms for Non-blind Deblurring . ECCV 2018. [pdf]
	Z. Lv, K. Kim, A. Troccoli, A. Sun, J. M. Rehg and Jan Kautz. Learning Rigidity in Dynamic Scenes with a Moving Camera for 3D Motion Field Estimation. ECCV 2018. [pdf] [code ] [data ]
	D. Sun, X. Yang, M-Y. Liu and J. Kautz. PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volume. CVPR 2018. Oral presentation. Winner of optical flow competition. NVAIL Pioneering Research Award. [pdf] [CVPR talk] [code]
	H. Jiang, D. Sun, V. Jampani, M-H. Yang, E. Learned-Miller and J. Kautz. Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolation. CVPR 2018. Spotlight presentation. Incorporated into NVIDIA NGX SDK for the Turing GPU. [pdf] [CVPR talk] [video results] [news] [code]
	H. Su, V. Jampani, D. Sun, S. Maji, E. Kalogerakis, M-H. Yang and J. Kautz. SPLATNet: Sparse Lattice Networks for Point Cloud Processing. CVPR 2018. Oral presentation. Best Paper Honorable Mention. NVAIL Pioneering Research Award. [pdf] [CVPR talk] [code]
	J. Pan, S. Liu, D. Sun, J. Zhang, Y. Liu, J. Ren, Z. Li, J. Tang, H. Lu, Y-W Tai and M-H Yang. Learning Dual Convolutional Neural Networks for Low-Level Vision. CVPR 2018. [pdf] [webpage] [code]
	Y-H. Tsai, M-Y. Liu, D. Sun, M-H. Yang, and J. Kautz. Learning Superpixels with Segmentation-Aware Affinity Loss. CVPR 2018. [pdf] [webpage] [code]
	W-C. Tu, M-Y. Liu, V. Jampani, D. Sun, S-Y. Chien, M-H. Yang and J. Kautz. Learning Binary Residual Representations for Domain-specific Video Streaming. AAAI 2018. [pdf]
	Z. Ren, D. Sun, J. Kautz, E. B. Sudderth. Cascaded Scene Flow Prediction using Semantic Segmentation. 3DV 2017. Oral presentation. [pdf]
	J. Pan, D. Sun, H. Pfister and M-H. Yang. Deblurring images via dark channel prior. TPAMI, pp. 2315-2328, Vol. 40, Issue 10, 2017 [pdf] [code]
	X. Xu, D. Sun, J. Pan, Y. Zhang, H. Pfister and M-H. Yang. Learning to Super-Resolve Blurry Face and Text Images. ICCV 2017. [pdf] [code]
	N. Bonneel, J. Tompkin, D. Sun, O. Wang, K. Sunkavalli, S. Paris and H. Pfister. Consistent Video Filtering for Camera Arrays. Eurographics 2017. [pdf] [code]
	J. Pan, D. Sun, H. Pfister and M-H. Yang. Blind Image Deblurring Using Dark Channel Prior. CVPR 2016. Oral presentation. [pdf] [code]
	L. Sevilla, D. Sun, V. Jampani and M. J. Black. Optical Flow with Semantic Segmentation and Localized Layers. CVPR 2016. Spotlight presentation. [pdf] [webpage] [video] [code]
	N. Bonneel, J. Tompkin, K. Sunkavalli, D. Sun, S. Paris and H. Pfister. Blind Video Temporal Consistency. SIGGRAPH Asia 2015. [pdf] [code] [code]
	D. Sun, E. B. Sudderth and H. Pfister. Layered RGBD Scene Flow Estimation. CVPR 2015. [pdf]
	D. Sun, S. Roth and M. J. Black. A Quantitative Analysis of Current Practices in Optical Flow Estimation and the Principles Behind Them. IJCV, 106(2):115-137, 2014. Journal version of the Longuet-Higgins Prize paper on "Secrets of Optical Flow". [pdf] [code]
	N. Bonneel, K. Sunkavalli, J. Tompkin, D. Sun, S. Paris and H. Pfister. Interactive Intrinsic Video Editing. SIGGRAPH Asia 2014. [pdf] [code] [data]
	L. Sevilla-Lara, D. Sun, E. Learned-Miller and MJ Black. Optical Flow Estimation with Channel Constancy . ECCV 2014. [pdf]
	D. Sun, C. Liu and H. Pfister. Local Layering for Joint Motion Estimation and Occlusion Detection. CVPR 2014. Oral presentation. [pdf]
	D. Sun, J. Wulff, E. B. Sudderth, H. Pfister and M. J. Black. A Fully-Connected Layered Model of Foreground and Background Flow. CVPR 2013. [pdf] [code]
	C. Liu and D. Sun. On Bayesian Adaptive Video Super Resolution. TPAMI, pp. 346-360, Vol. 36, Issue 2, 2014. [pdf]
	D. Sun. From Pixels to Layers: Joint Motion Estimation and Segmentation. Doctoral Thesis. Brown University. May, 2013. [pdf]
	D. Sun and C. Liu. Non-causal Temporal Prior for Video Deblocking. ECCV 2012. [pdf]
	D. Sun, E. B. Sudderth and M. J. Black. Layered Segmentation and Optical Flow Estimation Over Time. CVPR 2012. [pdf]
	C. Liu and D. Sun. A Bayesian Approach to Adaptive Video Super Resolution. CVPR 2011. Oral presentation. [pdf][webpage]
	D. Sun, E. B. Sudderth and M. J. Black. Layered Image Motion with Explicit Occlusions, Temporal Consistency, and Depth Ordering. NeurIPS 2010. Spotlight presentation. [pdf]
	D. Sun, S. Roth and M. J. Black. Secrets of Optical Flow Estimation and Their Principles. CVPR 2010. Longuet-Higgins (test-of-time) Prize at CVPR 2020. [pdf] [code] [Secrets of Secrets]
	D. Sun, S. Roth, J.P. Lewis and M. J. Black. Learning Optical Flow. ECCV 2008. Oral presentation. [pdf] code for [Black and Anandan ] [Horn and Schunck ]
	D. Sun and W-K. Cham. Postprocessing of Low Bit Rate Block DCT Coded Images based on a Fields of Experts Prior. TIP 16(11), pp. 2743- 2751, Nov. 2007. [pdf] [code]
	D. Sun. Postprocessing of Images Coded Using Block DCT at Low Bit Rates. M.Phil. Thesis. The Chinese University of Hong Kong. July, 2007 . [pdf]
	D. Sun and W-K. Cham. An Effective Postprocessing Method for Lowbit Rate Block DCT Coded Images. ICASSP 2007. [pdf] [code]