We have designed a remotely-controlled robot which equipped with a 360 degree full HD camera. User’s postures are detected by measuring the acceleration and rotation of changes of limb postures using inertial measurement units (IMU). User’s motion commands are wirelessly transmitted to actuate the remote robot in accordance with user’s posture. The 360 degree full scene camera keeps transmitting the real-time situation of the scene surrounding the robot back to the user, displayed on the VR headset.

Our lab has developed a IMU-based posture detection system for biped robot control. The IMU data generated from different posture motions are acquired and user’s postures are then recognized by deep learning network instantly. In contrast to other studies which requires the IMU data of full motion for posture detection, we calculate subject’s posture changes in every 0.1 second so that the robot can move following subject’s posture changes instantly. The IMU data are wirelessly transmitted to LSTM deep learning networks. Our current system can achieve detection accuracy higher than 95％.

According to the market report of IEK, the market size of global service robot is US＄17.8 billions and keeps increasing now. Our system combines the VR and IMU-based posture control to operate the robot. The VR provides the scene for users to immerse in the environment surrounding the robot and the IMU provides direct control of the robot. The system not only provides a direct and convenient way for people to operate a remote robot, but also a way for people to interact with each other under the pandemic of diseases.

線上展網址：
https://tievirtual.twtm.com.tw/iframe/a48cf9d9-2807-495f-94a3-d6eac9ec2505?group=23bfb1fa-dd5b-4836-81a1-4a1809b1bae5&lang=en