Alexis Paques
Published © MIT

The Autonomous Home Robot

Create an autonomous, AI-driven robot using audio API and an on-board, artificial neural network.

ExpertWork in progressOver 20 days2,712
The Autonomous Home Robot

Things used in this project

Hardware components

LinkIt Smart 7688 Duo
MediaTek Labs LinkIt Smart 7688 Duo
×1
Microphone Amplifier Breakout
Adafruit Microphone Amplifier Breakout
×3
Speaker: 0.25W, 8 ohms
Speaker: 0.25W, 8 ohms
×1
SparkFun Battery Babysitter - LiPo Battery Manager
SparkFun Battery Babysitter - LiPo Battery Manager
×8
Step-Up Voltage Regulator - 5V
SparkFun Step-Up Voltage Regulator - 5V
×1
Lipo battery (4800mAh) Tattu
×1
NEMA 17 Stepper Motor
OpenBuilds NEMA 17 Stepper Motor
×2
SparkFun Motor Driver - Dual TB6612FNG (1A)
SparkFun Motor Driver - Dual TB6612FNG (1A)
×1
Rotary encoder (wheel)
×1
Sweep 360 Lidar
×1
Arduino LCD Screen
Arduino LCD Screen
×1
SparkFun IMU Breakout - MPU-9250
SparkFun IMU Breakout - MPU-9250
×1
SparkFun RedBot Sensor - Mechanical Bumper
SparkFun RedBot Sensor - Mechanical Bumper
×1
Smooth Idler Pulley Wheel Kit
OpenBuilds Smooth Idler Pulley Wheel Kit
×4

Software apps and online services

Robot Operating System
ROS Robot Operating System
ThingSpeak API
ThingSpeak API
Programmable Voice API
Twilio Programmable Voice API
Amazon Alexa service
IFTTT Amazon Alexa service

Story

Read more

Schematics

Hardware design

Capture bhkgvo13ty

Code

Idea of the application

snippets
Listen the microphones => Web audio recognition API => Neural network 
IMU (gyroscope, accelerometer, compass) => Neural Network
Rotary wheels => Neural Netork
Sweep 360 LIDAR => Neural Network (Time delayed input)

Neural network => data => Text To Speak => Speakers
Neural network => impulsions => Motors 

Credits

Alexis Paques

Alexis Paques

4 projects • 12 followers
Lead Robotics Engineer

Comments

Add projectSign up / Login