3D Surgical Object recognition in complex environment

3D Surgical Object recognition in complex environment

Transfer learning will be used to recognize Surgical instruments in a complex environment.

Artificial Intelligence

  • 0 Collaborators

  • 0 Followers

    Follow

Description

In a surgery, a robotic arm can assist a doctor by handling equipment or holding things like clamps, scalpels, scissors, etc. One of the procedures the robot has to follow in order to fulfill this task is to detect where the object is inside the work-cell.\

The project will focus on recognizing different surgical instruments inside a robotic surgery work-cell using four Kinect RGB-D sensors, a ceiling mounted operating theater robot and transfer learning with a pre-trained CNN. The kinect sensors will acquire information from different viewpoints. The data will be used to classify objects taking into consideration the scenery constraints such as the light of the room, the color of the instruments and the occlusion that may happen due to a person or the limb of the robot blocking a sensor.

0 07ou4rujilqgtvgmilgyyrwy nbi5z2hjwi0saim8hbaqn3wili4zbwp35egpncwepiyf3optxiw9wtadx7qfiexlxii9wreex7msrn0k5sg9ot3e8xzy5pzm1

Hanz C. added photos to project 3D Surgical Object recognition in complex environment

Medium f5606582 a354 4c0f ae7d b915f477b398

3D Surgical Object recognition in complex environment

In a surgery, a robotic arm can assist a doctor by handling equipment or holding things like clamps, scalpels, scissors, etc. One of the procedures the robot has to follow in order to fulfill this task is to detect where the object is inside the work-cell.\\

The project will focus on recognizing different surgical instruments inside a robotic surgery work-cell using four Kinect RGB-D
sensors, a ceiling mounted operating theater robot and transfer learning with a pre-trained CNN. The kinect sensors will acquire information from different viewpoints. The data will be used to classify objects taking into consideration the scenery constraints such as the light of the room, the color of the instruments and the occlusion that may happen due to a person or the limb of the robot blocking a sensor.

Medium 0 07ou4rujilqgtvgmilgyyrwy nbi5z2hjwi0saim8hbaqn3wili4zbwp35egpncwepiyf3optxiw9wtadx7qfiexlxii9wreex7msrn0k5sg9ot3e8xzy5pzm1

Hanz C. created project 3D Surgical Object recognition in complex environment

Medium f5606582 a354 4c0f ae7d b915f477b398

3D Surgical Object recognition in complex environment

In a surgery, a robotic arm can assist a doctor by handling equipment or holding things like clamps, scalpels, scissors, etc. One of the procedures the robot has to follow in order to fulfill this task is to detect where the object is inside the work-cell.\

The project will focus on recognizing different surgical instruments inside a robotic surgery work-cell using four Kinect RGB-D sensors, a ceiling mounted operating theater robot and transfer learning with a pre-trained CNN. The kinect sensors will acquire information from different viewpoints. The data will be used to classify objects taking into consideration the scenery constraints such as the light of the room, the color of the instruments and the occlusion that may happen due to a person or the limb of the robot blocking a sensor.

No users to show at the moment.

No users to show at the moment.