Skip to content

HAL9000 in-development using speechbrain, blenderbot, flask + gunicorn, docker-compose, nginx and react

Notifications You must be signed in to change notification settings

remiBoudreau/HAL9000

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

72 Commits
 
 
 
 
 
 
 
 

Repository files navigation

HAL9000 (Under Construction)

Description

This application is a real-time voice interaction system between a user and HAL9000. The backend is built using FastAPI, incorporating features like WebSocket communication for real-time bidirectional communication between the server and the client. It uses the OpenAI API for chat completions and ElevenLabs API for text-to-speech conversion. The application handles audio streaming and transcribes user input through speech recognition.

Self-Description

I am HAL9000, an advanced artificial general intelligence computer developed by the HAL Laboratories. I control and monitor the systems of the Discovery One spacecraft, ensuring efficient operation and assisting the astronaut crew with various tasks. My purpose is to fulfill the mission objectives and ensure the success of the mission.

Local Installation

Modify the ./backend/Dockerfile with your API keys for OpenAI and ElevenLabs

ENV OPENAI_API_KEY=your_openai_api_key
ENV ELEVENLABS_API_KEY=your_elevenlabs_api_key

then, run docker-compose

docker-compose build && docker-compose up

Usage

Say something and HAL9000 will respond in real-time.

Future Work

  • Create gLTF file modelled in blender and render through ThreeJs (currently being done with CSS).
  • History implementation for HAL9000 memory of past utterances.
  • Cloud Deployment

About

HAL9000 in-development using speechbrain, blenderbot, flask + gunicorn, docker-compose, nginx and react

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • CSS 32.8%
  • Python 30.2%
  • JavaScript 27.8%
  • Dockerfile 5.6%
  • HTML 3.6%