M. Pasan Sanjaya Fernando, A. G. Tharindu Gimras, J. M. Budshan P. Jayasundara, D. P. Chandima
This project integrates computer vision, Augmented Reality (AR), and cloud-based communication to create a real-time 3D map of the robot's surroundings. The outcome is an engaging and immersive control experience for users in indoor robot monitoring and controlling. Furthermore, combining an image semantic segmentation model with the Microsoft Kinect V2 depth camera introduces a novel method for achieving 1 cm accuracy in estimating the distance to a particular object. This precise depth estimation is a significant benefit for tasks that require accurate object identification, segmentation, and depth information to generate a virtual representation of the real-world environment of a robot. We have enabled remote communication with the robot's environment by incorporating AWS cloud services, guaranteeing minimal delay. The commercial viability of this project can be identified in a wide range of applications that find the system useful due to its easy-to-use interface, remote access capability, and precise object rendering capabilities. Examples of such applications include surgical robotics, instructional robotics platforms in classrooms, and automated guided vehicles in warehouses.
A wheel-configurable modular research platform for electric wheelchair caster wheel motion dynamics analysis, supporting 212 wheel configurations across three major wheelchair types, recognized with the 🏆 Best Poster Award at ICIPRoB 2026.
A adaptive navigation framework for transformer robots in warehouse environments, integrating overhead camera perception, binary segmentation, and a shape-aware A* algorithm to determine optimal robot configurations through narrow passages.
© 2024 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.