Siyu Zhang

张思宇

Co-Founder | R&D Director
4DV.ai
About me

I'm currently the co-founder and R&D director of 4DV.ai, a startup that is building the next generation of visual media. I'm also affiliated with State Key Lab of CAD & CG, Zhejiang University(ZJU), working closely with the 3D Vision Group led by Prof. Xiaowei Zhou.

I received my bachelor's degree in 2020 from the department of CSE, SUSTech. I spent three amazing years at 3DV&MR Group of SenseTime Research as Intern and Full-time Research Engineer, where I developed 3D Object Recognition algorithms for applications related Augmented Reality as well as participated in various research projects. I co-founded Image Derivative Inc. (IDR) and worked there as R&D Director for 2 years.

Research Interests

My interest lies in general 3D Computer Vision and Deep Learning with a special interest in understanding and digitalization of 3D scenes. Although working mostly as a full-stack research engineer to develop working solutions out of state-of-the-art technologies, I'm also fascinated with tackling fundamental challenges in 3D Vision through research and have engaged in a couple of exciting research projects.

Rescent News

    [Mar. 2022] One paper about object pose estimation accepted by CVPR 2022.
    [Jul., 2021] One paper about 3D object detection accepted by ICCV 2021.
    [Jul, 2020] Graduated from SUSTech and will be joining ZJU-Sensetime Joint Lab of 3D Vision as a full-time researcher.
    [Jan, 2020] One paper about 3D object detection accepted by CVPR 2020.
Education
[Southern University of Science and Technology]
[Southern University of Science and Technology]
Southern University of Science and Technology
Shenzhen, China
Publications

OnePose: One-Shot Object Pose Estimation without CAD Models
Siyu Zhang*, Jiaming Sun*, Zihao Wang*, Xingyi He, Hongcheng Zhao, Guofeng Zhang, Xiaowei Zhou.
CVPR 2022.
[Paper][Project Page][Code]

You Don’t Only Look Once: Constructing Spatial-Temporal Memory for Integrated 3D Object Detection and Tracking
Jiaming Sun*, Yiming Xie*, Siyu Zhang, Linghao Chen, Guofeng Zhang, Hujun Bao, Xiaowei Zhou.
ICCV 2021. (Strong Accept * 2 in final rating)
[Paper][Project Page][Code]


Disp

Stereo 3D Object Detection via Shape Prior GuidedInstance Disparity Estimation
Jiaming Sun*, Linghao Chen*, Yiming Xie, Siyu Zhang, Qinhong Jiang, Xiaowei Zhou. (*-indicates equal contributions)
CVPR 2020, TPAMI 2021
[CVPR Paper][TPAMI Paper][Code]

Talk & Prensetations

Paper Review on Object 6D Pose Estimations:

  • [08/2020] Andvances in Object 6D Pose (mainly covered papers published in CVPR 20' and ECCV 20')[PDF]
  • [10/2020] Object 6D Pose Estimation by Action & Decision[PDF]
  • [04/2020] Object 6D Pose by Render & Compare[PDF]

Other topics:

  • [04/2021] Radiance-based Neural RGB-D reconstruction[PDF]

Miscellaneous

Besides working on cutting-edge technologies and building startups, I'm also a Jazz bassist. I have been playing at renowned Jazz venus in Hangzhou and Shanghai including Huanglou Club, Wooden Box, JZ Club and JZ Live. I'm hornored to have sutdied with top musicians from China and around the world, including: Wenjun (Vino) Wu, Ron Carter, Clovis Nicolas, Carlos Henriquez, Russell Hall and many more.

Videos of me playing as well as my musical blogs can be found on my Red Note.