Junsheng Zhou | 周俊昇

I am currently a Ph.D. student in School of Software, Tsinghua University, advised by Prof. Yu-Shen Liu.

My research interests lie in the area of 3D computer vision and graphics, especially in generative models, 3D foundation models, 3D reconstruction and cross-modal learning.

Email  /  Google Scholar  /  GitHub

profile photo
News
  • 03/2025: I am honored to be awarded the Baidu Scholarship (10 Ph.D students worldwide)!
  • 02/2025: Two papers (NeRFPrior and Bijective-SDF) are accepted to CVPR 2025 (1 Highlight).
  • 09/2024: Three papers (DiffGS, DeepPriorAssembly and Binocular3DGS) are accepted to NeurIPS 2024.
  • 06/2024: Our paper FastN2N on fast learning of implicit 3D representations is accepted to TPAMI 2024.
  • 04/2024: The extension of CAP-UDF on implicit representations is accepted to TPAMI 2024.
  • 03/2024: Our paper UDiFF on UDF-based 3D generative models is accepted to CVPR 2024.
  • 03/2024: I will co-organize workshop EMbodied AI: Trends, Challenges, and Opportunities in ICIP 2024.
  • 02/2024: Our paper 3D-OAE on 3D foundation models is accepted to ICRA 2024 for Oral presentation.
  • 01/2024: Our work Uni3D on scaling up 3D foundation models is accepted to ICLR 2024 (Spotlight).
  • 12/2023: Two papers on multi-view reconstruction and point upsampling is accepted to AAAI 2024.
  • 10/2023: Releasing Uni3D, a unified 3D foundation model with one billion parameters.
  • 09/2023: Our paper VP2P-Match on image to LiDAR point cloud registration is accepted to NeurIPS 2023 (Spotlight).
  • ---- show more ----
Research

Selected Publications |   All Publications

DiffGS: Functional Gaussian Splatting Diffusion
Junsheng Zhou*, Weiqi Zhang*, Yu-Shen Liu
Conference on Neural Information Processing Systems (NeurIPS), 2024
project page | arXiv | code

Introducing a powerful 3D generative model that generates Gaussian primitives in arbitrary numbers by functionally disentangling Gaussian Splatting.

Zero-Shot Scene Reconstruction from Single Images with Deep Prior Assembly
Junsheng Zhou, Yu-Shen Liu, Zhizhong Han
Conference on Neural Information Processing Systems (NeurIPS), 2024
project page | arXiv | code

We propose to assemble diverse deep priors from large models for scene generation from single images in a zero shot manner.

Fast Learning of Signed Distance Functions from Noisy Point Clouds via Noise to Noise Mapping
Junsheng Zhou*, Baorui Ma*, Yu-Shen Liu, Zhizhong Han
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024
project page | IEEE Xplore | arXiv | code

We present a fast learning framework capable of inferring signed distance functions from noisy shapes within one minute through noise-to-noise mapping.

UDiFF: Generating Conditional Unsigned Distance Fields with Optimal Wavelet Diffusion
Junsheng Zhou*, Weiqi Zhang*, Baorui Ma, Kanle Shi, Yu-Shen Liu, Zhizhong Han
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024
project page | arXiv | code

UDiFF is a 3D diffusion model for unsigned distance fields (UDFs) which is capable to generate textured 3D shapes with open surfaces from text conditions or unconditionally.

CAP-UDF: Learning Unsigned Distance Functions Progressively from Raw Point Clouds with Consistency-Aware Field Optimization
Junsheng Zhou*, Baorui Ma*, Shujuan Li, Yu-Shen Liu, Yi Fang, Zhizhong Han
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024
project page | IEEE Xplore | arXiv | code

We present CAP-UDF to represent shapes and scenes with arbitrary architecture by learning a Consistency-Aware unsigned distance function Progressively.

Uni3D: Exploring Unified 3D Representation at Scale
Junsheng Zhou*, Jinsheng Wang*, Baorui Ma*, Yu-Shen Liu, Tiejun Huang, Xinlong Wang
International Conference on Learning Representations (ICLR), 2024 (Spotlight)
Model Zoo | arXiv | code

We present Uni3D, a unified and scalable 3D pretraining framework for large-scale 3D representation learning, and explore its limits at the scale of one billion parameters.

3D-OAE: Occlusion Auto-Encoders for Self-Supervised Learning on Point Clouds
Junsheng Zhou*, Xin Wen*, Baorui Ma, Yu-Shen Liu, Yue Gao, Yi Fang, Zhizhong Han
IEEE International Conference on Robotics and Automation (ICRA), 2024 (Oral)
project page | arXiv | code

We present 3D-OAE, a novel self-supervised point cloud representation learning framework which is highly efficient and can be further transferred to various downstream tasks.

Differentiable Registration of Images and LiDAR Point Clouds with VoxelPoint-to-Pixel Matching
Junsheng Zhou*, Baorui Ma*, Wenyuan Zhang, Yi Fang, Yu-Shen Liu, Zhizhong Han
Conference on Neural Information Processing Systems (NeurIPS), 2023 (Spotlight)
project page | arXiv | code

We design a triplet network to learn VoxelPoint-to-Pixel matching via a differentiable probabilistic PnP solver.

Learning a More Continuous Zero Level Set in Unsigned Distance Fields through Level Set Projection
Junsheng Zhou*, Baorui Ma*, Shujuan Li, Yu-Shen Liu, Zhizhong Han
IEEE/CVF International Conference on Computer Vision (ICCV), 2023
project page | arXiv | code

We propose to guide the learning of zero level set in UDF using the rest non-zero level sets via a projection procedure.

Learning Consistency-Aware Unsigned Distance Functions Progressively from Raw Point Clouds
Junsheng Zhou*, Baorui Ma*, Yu-Shen Liu, Yi Fang, Zhizhong Han
Conference on Neural Information Processing Systems (NeurIPS), 2022
project page | arXiv | code

We present CAP-UDF to represent shapes and scenes with arbitrary architecture by learning a Consistency-Aware unsigned distance function Progressively.

Honors and Awards
  • Baidu Scholarship (百度奖学金, 10 Ph.D students worldwide), 2024.
  • National Scholarship (国家奖学金, Top 1% at Tsinghua University), 2023.
  • The 3rd Place in the MVP Completion Challenge (ICCV 2021 Workshop), 2021.
  • Best Poster Paper Awards on ChinaVR, 2021.
Academic Services
  • Co-organizer: "EMbodied AI: Trends, Challenges, and Opportunities" in ICIP-24
  • Program Committee Member: ICLR-24, IJCAI-24, WWW-24, AAAI-25
  • Conference Reviewer: NeurIPS-23/24/25, ICML-24/25, CVPR-23/24/25, ICCV-23/25, SIGGRAPH Asia-24, ECCV-24, ACM MM-25, BMVC-23/24, AISTATS-25, WACV-25
  • Journal Reviewer: TOG, TVCG, TIP, CVMJ, RA-L, TCSVT

template adapted from this awesome website
Last updated: May 2024