PhD Project Page

David Gollasch, Research Associate @ Technische Universität Dresden, Germany

Our goal is to develop an “AAA” – adaptive, accessibly assistance robot to support people with special needs as well as elderly people during their daily life; whether they are at home or in complex public environments.

My goal is to help the Elderly with special needs to stay independent by engineering self-learning assistance robots.

We are constantly working on new features to build up a multi-purpose robot that is able to adapt to the user’s needs and preferences. For getting there, we follow two development paths. First, we are implementing many “function bits” or features for our robot ﹣ similar to building blocks for later task process chains. Second, we are developing a match-making system to construct the named process chains adaptively, based on the user’s needs. The result shall become our final A3Bot system.

We are working with the Segway Robotics Loomo platform. A versatile, affordable, Android-based robot on wheels, which is a self-balancing vehicle at the same time.

Project Progress
Requirements Analysis
Development Progress
Component Prototyping

Components

Human-Robot Interaction

Amazon Alexa Integration

Turing Loomo into an Alexa client to enable natural voice interaction and get access to existing skills. Furthermore, controlling the robot using voice commands handled by Alexa.

Augmented Reality

Extending the visual output by projecting information onto objects using an attached LED projector.

Emotion Modelling

Defining an emotion model that can be applied to Loomo to express emotions.

Emotion Recognition

Recognising emotions using the RGB HD camera of a personal robot and machine learning. Sensor fusion for refinement.

Gesture Control

Designing body gestures to control the Loomo personal robot.

Microsoft Voice Service Integration

Interact with Loomo via your voice; approach using Microsoft voice services.

MyCroft.ai Integration

Interact with Loomo via your voice; approach using the open source voice assistant MyCroft.ai

Adaptivity

User Identification

Getting to know new users and identify them using their voice.

Navigation

Driving Using Ultrasonic Sensors

Let a personal robot drive around and explore its environment by only using the ultrasonic sensor to avoid collisions.

Floor Plan Navigation

Mapping and Navigation Approach Based on Exit Plans

Obstacle Avoidance

Obstacle detection and path correction based on 3D and ultrasonic sensors.

Applications

Caring Assistance

Implementing features that support people with dementia keeping up personal responsibility during everyday activities.

Cooperative Drone-Robot Interaction

Fetching objects using a drone that is controlled by Loomo.

Smart Home Integration

Integration of smart-home sensors and actors into the robot’s ecosystem using Z-Wave to enable Loomo to interact with its environmental gadgets.