Drone Control via Alexa
github.comVery cool! If you want to do this in a 100% on-device and private-by-design way, you can take a look at what we are building at https://snips.ai (disclaimer: I'm a co-founder)
Someone actually already did a Voice controlled drone with the platform https://github.com/trancept/snips_bebop/ :)
It runs on a Raspberry Pi 3, or any Linux, osX, iOS, Android device, and it works in English, French, German, Japanese, Spanish, Italian, and more coming soon!
We'd love to show what you are building on our blog if you want to use it :)
Second the recommendation for Snips. I recently built a Snips-based voice assistant for hands-free oscilloscope control (https://github.com/jmwilson/ollie), and snips is a much better fit for this kind of domain-specific, field-deployable (offline) voice assistant.
Consider the whole of infrastructure required for this application. The Pi sends a request to Alexa, which sends a request to a lambda server, which sends a request to SQS, which is polled by the Pi. Each of those AWS servers has possible subsystems and some load balancer in front of it. Single device, offline processing is so much cleaner when there's no need for general connectivity.
Thanks! My implementation is meant for remote voice control of drone.
I did something similar about six years ago: https://www.youtube.com/watch?v=uhBa11gdbeU
I used a (Python) natural language parser of my own creation (this was before intent classification was a big thing), Nuance speech recognition, and a javascript (node) interface to the AR.Drone.
Haha- the drone not landing when you told it to is basically the beginning of every sci-fi movie where the robots turn on the people.
Great job.
TODO: add a kill switch :D
Seriously impressive! I particularly noted the speed of command to actuation.
I also did this a few years ago - voice controlled drone, had some keyboard based kill switches, unfortunately the drone is quite noisy so had to talk quite loudly to get a decent STT translation.
This setup just requires raspberry-pi to be in the vicinity of drone. Voice command can be provided remotely.
Deja vu -- a group of friends and I tried out something similar at a hackathon a while back, and it ended up pretty decent
That's pretty cool, though, knowing me and Alexa I will send that drone to the first wall or tree around me lol.
This seems oh-so-dangerous given the current state of NLP, but very cool project! :)
Thanks! I saw the fear in my Director's eyes while showcasing when the drone was hovering ~3 feet away.
Not bad! Be interesting to include this tech into a FPV drone headset which could yield serviceable complete heads-up control for area sightseeing. BTW hope you turned off the projected sniper's reticle during the demo as this does tend to elicit angst in the observers - sorry :-)
"Alexa, search and destroy"
this is a crash waiting to happen