Teleoperation of Robotic Arm
Background
Advances in teleoperation technology are pushing the boundaries of human-robot interaction in robotics. Vision-based teleoperation, using advanced cameras and low-latency connections, leads this revolution. By linking human intent to robotic movement, vision-based teleoperation gives operators precise control over robotic arms, unlocking numerous applications. These applications allow operations in hazardous or inaccessible environments. Moreover, teleoperation involves experts remotely, improving overall performance.
What is FCTLab developing?
Our focus lies in 5G-driven teleoperation of robotic arm platform. These include but not limited to:
Feedback loop to optimise a more accurate control of the robotic arm.
Speed and acceleration control for a more representative movement of the robotic arm.
Algorithm to reduce noise for the control of the arm.
Integration of motion-tracking algorithm to enable arm control.
System Model
The environment is captured by multiple depth camera placed around the operation site. Information of the site can be reconstructed in real-time and transmitted over the 5G network.
The reconstructed environment are point-cloud data which uses high bandwidth for an accurate representation. 5G network will be able to facilitate such transfer of large volume of data. The transmitted data will then be projected through the Virtual-Reality (VR) headset and thus allow the operator to have a better understanding of the operating environment
The control of the robotic arm is achieved by capture the position of the hand in 3D space using the depth camera. Thereafter, the camera’s space is translated to the robotic arm’s command and transmitted over the 5G network.
Leveraging on 5G low-latency capability, the operator will be able to have a more responsive feedback response of the robotic arm and therefore achieving a more intuitive operation for a better performance.
Use Case Examples
Hazardous working environment
Workers welding in confined space are subjected to asphyxiation hazard. By replacing the worker to enter confine space to perform fine-motor skill work such as welding can remove such hazard presented to the workers.
Distance-extended teleoperation
Performing task such as picking up foreign object debris over a long distance may prove to be unproductive. By having a robot to travel autonomously and human to intervene and perform fine-motor skill task can improve productivity by remove the requirement of human to trave.
Operation in small space
When a building collapses during a disaster, there might be spaces where human is unable to reach. Teleoperation of robot can allow smaller-sized robot to reach location and perform rescue, thereby enabling operation previously deemed as impossible.