Invention Grant
- Patent Title: Methods, systems, and computer readable media for three-dimensional (3D) reconstruction of colonoscopic surfaces for determining missing regions
-
Application No.: US16513632Application Date: 2019-07-16
-
Publication No.: US10682108B1Publication Date: 2020-06-16
- Inventor: Ruibin Ma , Rui Wang , Stephen Murray Pizer , Jan-Michael Frahm , Julian Gary Rosenman , Sarah Kelly McGill
- Applicant: The University of North Carolina at Chapel Hill
- Applicant Address: US NC Chapel Hill
- Assignee: THE UNIVERSITY OF NORTH CAROLINA AT CHAPEL HILL
- Current Assignee: THE UNIVERSITY OF NORTH CAROLINA AT CHAPEL HILL
- Current Assignee Address: US NC Chapel Hill
- Agency: Jenkins, Wilson, Taylor & Hunt, P.A.
- Main IPC: A61B6/00
- IPC: A61B6/00 ; A61B1/31 ; G06T15/20 ; G06T7/20 ; G06T7/136 ; G06T7/00

Abstract:
Methods, systems, and computer readable media for deriving a three-dimensional (3D) surface from colonoscopic video are disclosed. According to one method for deriving a 3D surface from colonoscopic video, the method comprises: performing video frame preprocessing to identify a plurality of keyframes of a colonoscopic video, wherein the video frame preprocessing includes informative frame selection and keyframe selection; generating, using a recurrent neural network and direct sparse odometry, camera poses and depth maps for the keyframes; and fusing, using SurfelMeshing and the camera poses, the depth maps into a three-dimensional (3D) surface of a colon portion, wherein the 3D surface indicates at least one region of the colon portion that was not visualized.
Information query