About me
I am a Research Scientist at NVIDIA Research,
working on 3D reconstruction, generation and embodied AI.
I received my Ph.D. degree from Johns Hopkins University on visual servoing for surgical robotics,
advised by Dr.
Russell H Taylor and
co-advised by Dr. Mathias
Unberath.
I received my Bachelor degree from University of British Columbia, advised by Dr. Tim Salcudean.
I have also been fortunate to collaborate with many brilliant minds at NVIDIA, JHU, UBC, Meta Reality Labs
and Intuitive.
Updates
10.24.2023
|
Neuralangelo has been named as the TIME's Best Inventions of 2023! |
06.21.2023
|
Our paper Twin-S won Best Paper Award Honorable Mention at IPCAI 2023! |
03.24.2023
|
I have defended my thesis! Full talk can be found here. |
09.18.2022
|
Our paper AMBF+ won Best Paper Award at AE-CAI 2022! |
07.30.2021
|
STTR accepted at ICCV 2021 as an Oral Paper! |
Selected Work
Neuralangelo:
High-Fidelity Neural Surface Reconstruction
Zhaoshuo Li, Thomas Müller, Alex Evans, Russell H Taylor, Mathias Unberath, Ming-Yu Liu, Chen-Hsuan Lin
CVPR 2023, TIME's Best Inventions of 2023
Zhaoshuo Li, Thomas Müller, Alex Evans, Russell H Taylor, Mathias Unberath, Ming-Yu Liu, Chen-Hsuan Lin
CVPR 2023, TIME's Best Inventions of 2023
Temporally
Consistent Online Depth Estimation in Dynamic Scenes
Zhaoshuo Li, Wei Ye, Dilin Wang, Francis X Creighton, Russell H Taylor, Ganesh Venkatesh, Mathias Unberath
WACV 2023
Zhaoshuo Li, Wei Ye, Dilin Wang, Francis X Creighton, Russell H Taylor, Ganesh Venkatesh, Mathias Unberath
WACV 2023
Revisiting
stereo depth estimation from a sequence-to-sequence perspective with
transformers
Zhaoshuo Li, Xingtong Liu, Nathan Drenkow, Andy Ding, Francis X Creighton, Russell H Taylor, Mathias Unberath
ICCV 2021, Oral
Zhaoshuo Li, Xingtong Liu, Nathan Drenkow, Andy Ding, Francis X Creighton, Russell H Taylor, Mathias Unberath
ICCV 2021, Oral
Anatomical
Mesh-Based Virtual Fixtures for Surgical Robots
Zhaoshuo Li, Alex Gordon, Thomas Looi, James Drake, Christopher Forrest, Russell H Taylor
IROS 2020
Zhaoshuo Li, Alex Gordon, Thomas Looi, James Drake, Christopher Forrest, Russell H Taylor
IROS 2020
Work Experience
Deep Imagination Research, NVIDIA
Research Scientist
September 2023 – Current
Research Scientist
September 2023 – Current
Deep Imagination Research, NVIDIA
Research Intern
June 2022 – August 2022
Research Intern
June 2022 – August 2022
Meta Reality Labs
Research Intern
June 2021 – August 2021
Research Intern
June 2021 – August 2021
Intuitive
Research Intern
June 2019 – August 2019
Research Intern
June 2019 – August 2019
Publications/Preprints
Vision Navigation and 3D Reconstruction
-
TAToo:
Vision-based Joint Tracking of Anatomy and Tool for Skull-base Surgery
Zhaoshuo Li, Hongchao Shu, Ruixing Liang, Anna Goodridge, Manish Sahu, Francis X Creighton, Russell H Taylor, Mathias Unberath
IPCAI 2023 -
Rethinking
Causality-driven Robot Tool Segmentation with Temporal Constraints
Hao Ding, Jie Ying Wu, Zhaoshuo Li, Mathias Unberath
IPCAI 2023 -
Context-Enhanced Stereo Transformer
Weiyu Guo, Zhaoshuo Li, Yongkui Yang, Zheng Wang, Russell H Taylor, Mathias Unberath, Alan Yuille, Yingwei Li
ECCV 2022 -
SAGE: SLAM with
Appearance and Geometry Prior for Endoscopy
Xingtong Liu, Zhaoshuo Li, Masaru Ishii, Gregory D Hager, Russell H Taylor, Mathias Unberath
ICRA 2022 -
E-DSSR:
Efficient Dynamic Surgical Scene Reconstruction with Transformer-based Stereoscopic
Depth Perception
Yonghao Long*, Zhaoshuo Li*, Chi Hang Yee, Chi Fai Ng, Russell H Taylor, Mathias Unberath, Qi Dou
*: equal contribution
MICCAI 2021 -
On the Sins of
Image Synthesis Loss for Self-supervised Depth Estimation
Zhaoshuo Li, Nathan Drenkow, Hao Ding, Andy S. Ding, Alexander Lu, Francis X Creighton, Russell H Taylor, Mathias Unberath
Technical Report
Robotics and Mixed Reality
-
Improving
Surgical Situational Awareness with Signed Distance Field: A Pilot Study in Virtual
Reality
Hisashi Ishida, Juan Antonio Barragan, Adnan Munawar, Zhaoshuo Li, Peter Kazanzides, Michael Kazhdan, Danielle Trakimas, Francis X Creighton, Russell H Taylor
IROS 2023 -
Twin-S: A
Digital Twin for Skull-base Surgery
Hongchao Shu*, Ruixing Liang*, Zhaoshuo Li*, Anna Goodridge, Xiangyu Zhang, Hao Ding, Nimesh Nagururu, Manish Sahu, Francis X Creighton, Russell H Taylor, Adnan Munawar, Mathias Unberath
*: equal contribution
IPCAI 2023
Best Paper Award Honorable Mention -
Fully Immersive
Virtual Reality for Skull-base Surgery: Surgical Training and Beyond
Adnan Munawar, Zhaoshuo Li, Nimesh Nagururu, Danielle Trakimas, Peter Kazanzides, Russell H Taylor, Francis X Creighton
IPCAI 2023 -
Virtual reality
for synergistic surgical training and data generation
Adnan Munawar, Zhaoshuo Li, Punit Kunjam, Nimesh Nagururu, Andy S. Ding, Peter Kazanzides, Thomas Looi, Francis X Creighton, Russell H Taylor, Mathias Unberath
AE-CAI Workshop, MICCAI 2021
Best Paper Award -
Evaluation of Hybrid Control and Palpation Assistance
for Situational Awareness in Telemanipulated Task Execution
Rashid Yasin, Preetham Chalasani, Nicolas Zevallos, Mahya Shahbazi, Zhaoshuo Li, Anton Deguet, Peter Kazanzides, Howie Choset, Russell H Taylor, Nabil Simaan
TMRB 2020
Journal Article -
A Robotic 3D
Perception System for Operating Room Environment Awareness
Zhaoshuo Li, Amirreza Shaban, Jean-Gabriel Simard, Dinesh Rabindran, Simon DiMaio, Omid Mohareri
IPCAI 2020 -
Hybrid Robot-assisted Frameworks for Endomicroscopy
Scanning in Retinal Surgeries
Zhaoshuo Li, Mahya Shahbazi, Niravkumar Patel, Eimear O' Sullivan, Haojie Zhang, Khushi Vyas, Preetham Chalasani, Anton Deguet, Peter L Gehlbach, Iulian Iordachita, Guang-Zhong Yang, Russell H Taylor
TMRB 2020
Journal Article -
A Novel Semi-Autonomous Control Framework for Retina
Confocal Endomicroscopy Scanning
Zhaoshuo Li, Mahya Shahbazi, Niravkumar Patel, Eimear O’Sullivan, Haojie Zhang, Khushi Vyas, Preetham Chalasani, Peter L Gehlbach, Iulian Iordachita, Guang-Zhong Yang, Russell H Taylor
IROS 2019 -
Free head movement eye gaze contingent ultrasound
interfaces for the da vinci surgical system
Zhaoshuo Li, Irene Tong, Leo Metcalf, Craig Hennessey, Septimiu E Salcudean
ICRA/RAL 2018
Journal Article -
Eye Gaze Contingent Ultrasound Interfaces for the da
Vinci Surgical System
Zhaoshuo Li, Irene Tong, Septimiu E Salcudean
Shared Platforms Workshop, IROS 2017
Clinical Analysis
-
A Self-Configuring Deep Learning Network for
Segmentation of Temporal Bone Anatomy in Cone-Beam CT Imaging
Andy S Ding, Alexander Lu, Zhaoshuo Li, Manish Sahu, Deepa Galaiya, Jeffrey H Siewerdsen, Mathias Unberath, Russell H Taylor, Francis X Creighton
Otolaryngology–Head and Neck Surgery 2023 -
Statistical
Shape Model of the Temporal Bone Using Segmentation Propagation
Andy S Ding, Alexander Lu, Zhaoshuo Li, Deepa Galaiya, Masaru Ishii, Jeffrey H Siewerdsen, Russell H Taylor, Francis X Creighton
Otology & Neurotology 2022 -
Automated Extraction of Anatomical Measurements From
Temporal Bone CT Imaging
Andy S Ding, Alexander Lu, Zhaoshuo Li, Deepa Galaiya, Masaru Ishii, Jeffrey H Siewerdsen, Russell H Taylor, Francis X Creighton
Otolaryngology–Head and Neck Surgery 2022 -
Automated registration-based temporal bone computed
tomography segmentation for applications in neurotologic surgery
Andy S Ding, Alexander Lu, Zhaoshuo Li, Deepa Galaiya, Jeffrey H Siewerdsen, Russell H Taylor, Francis X Creighton
Otolaryngology–Head and Neck Surgery 2021 -
An
Interpretable Approach to Automated Severity Scoring in Pelvic Trauma
Anna Zapaishchykova, David Dreizin, Zhaoshuo Li, Jie Ying Wu, Shahrooz Faghih Roohi, Mathias Unberath
MICCAI 2021 -
Volumetric Accuracy Analysis of Virtual Safety
Barriers for Cooperative-Control Robotic Mastoidectomy
Andy S Ding, Sarah Capostagno, Christopher R Razavi, Zhaoshuo Li, Russell H Taylor, John P Carey, Francis X Creighton
Otology & Neurotology 2021