Skip to content

EVA: a social ๐Ÿ—ฃ, affective โค๏ธ and proactive ๐Ÿง  robot for older adults ๐Ÿ‘ด๐Ÿป

Notifications You must be signed in to change notification settings

Laura-VFA/Affective-Proactive-EVA-Robot

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 

History

82 Commits
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

Eva-Assistant-Python

EVA is a social ๐Ÿ—ฃ and affective โค๏ธ robot aimed at assisting older adults in conducting Instrumental Activities of Daily Living (IADLs). It is not only a passive assistant, but an active one: proactive behaviour is incorporated in the robot. It can start conversations and show concern about the user, making the interaction more natural and affective.
This repo contains the brain ๐Ÿง  structure of the robot, the proactive and interaction behavior themselves.

Be different ๐Ÿ˜Ž

With EVA, you can have conversations in the more natural way. It is activated by a novel method called wakeface, in which the robot activates/listens the user by looking at it. Also, it is able to start conversations by using proactive questions.

Highlighted proactive questions โœจ how are you, who are you
Other hightlighted (cool) services reading incoming telegram messages, sending telegram messages

What are you waiting for to meet it? Construct your own EVA today! ๐Ÿ”

Main components ๐Ÿค–๐Ÿ› ๏ธ

EVA hardware structure is based on the existing EVA robotic platform. This EVA affective and proactive version is constructed using the following elements:

It is not mantadory to have exactly the same components, as long as they have the same functionalities. If you change any of them, make sure you have the correct drivers. In particular, if camera is changed, camera frames capturing code must be rewritten to use the suitable library for your camera management (it will probably not be pyrealsense2).

Installation โš™๏ธ

Requirements

Use the package manager pip to install all the pre-requisites.

pip3 install -r requirements.txt

Google and IBM services

Ensure you have IBM Cloud and Google Cloud accounts.

It is necessary to have apikeys ๐Ÿ”‘ for the following services:

Both files (Google credentials and IBM credentials) must be stored in a credentials/ directory, located outside the main project directory:

$ any_directory
.
โ”œโ”€โ”€ credentials
โ”‚   โ”œโ”€โ”€ google_credentials.json
โ”‚   โ”œโ”€โ”€ assistant_credentials.json
โ”‚   โ””โ”€โ”€ ibm_credentials.env
โ””โ”€โ”€ Eva-Assistant-Python/

In this case, by-default environment variables provided by Google and IBM (GOOGLE_APPLICATION_CREDENTIALS and IBM_CREDENTIALS_FILE) are used for automatic services apikey authentication (easier!). Also, a WATSON_ASSISTANT_CREDENTIALS variable containing assistant_credentials.json path is used for obtaining the assistant id.

WARNING โš ๏ธ: IBM Watson Assistant dialog tree can be freely designed by the user. This makes more flexible and customized the user interaction with your own robot ๐Ÿ˜‰

Telegram service ๐Ÿ’ฌ

Follow these steps:

  1. Get your own api_id and api_hash from Telegram (click here and follow the instructions), under API Development.
  2. Store them in a telegram_credentials.json file. This file must be located in credentials/ directory, and should be like this:
{
  "api_id" : 12345,
  "api_hash" : "0123456789abcdef0123456789abcdef"
}
  1. Create your telegram.session file, located also in credentials/ directory. Using Telethon library is very easy.
  2. Create two environment variables TELEGRAM_CREDENTIALS and TELEGRAM_SESSION which contain their corresponding paths.
  3. Enjoy the service!

Usage ๐Ÿš€

For executing EVA, you only have to run from root repo directory:

python3 main.py

โžก๏ธNote: proactive_phrases.json contains phrases totally in spanish, so if you want EVA to speak in a different language, teach it your language by changing this file and developing the IBM Watson Assistant dialog tree in your language. It will be happy to learn it ๐Ÿ˜Š

And that's how you construct your own affective robot! ๐Ÿค–โค๏ธ๐Ÿ‘ฉ๐Ÿป

Authors ๐Ÿ“

About

EVA: a social ๐Ÿ—ฃ, affective โค๏ธ and proactive ๐Ÿง  robot for older adults ๐Ÿ‘ด๐Ÿป

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages