Background

Advances in teleoperation technology are pushing the boundaries of human-robot interaction in robotics. Vision-based teleoperation, using advanced cameras and low-latency connections, leads this revolution. By linking human intent to robotic movement, vision-based teleoperation gives operators precise control over robotic arms, unlocking numerous applications. These applications allow operations in hazardous or inaccessible environments. Moreover, teleoperation involves experts remotely, improving overall performance.

The environment is captured by multiple depth camera placed around the operation site. Information of the site can be reconstructed in real-time and transmitted over the 5G network.

The reconstructed environment are point-cloud data which uses high bandwidth for an accurate representation. 5G network will be able to facilitate such transfer of large volume of data. The transmitted data will then be projected through the Virtual-Reality (VR) headset and thus allow the operator to have a better understanding of the operating environment

The control of the robotic arm is achieved by capture the position of the hand in 3D space using the depth camera. Thereafter, the camera’s space is translated to the robotic arm’s command and transmitted over the 5G network.

Leveraging on 5G low-latency capability, the operator will be able to have a more responsive feedback response of the robotic arm and therefore achieving a more intuitive operation for a better performance.

Use Case Examples