I scripted Reachy Mini to pass the Blade Runner Baseline
JetsonHacks 5:51
588 views · 11 likes Watch on YouTube ↗
Join this channel to get access to perks:
https://www.youtube.com/channel/UCQs0lwV6E4p7LQaGJ6fgy5Q/join
I always liked the Blade Runner movies, so recreating a Baseline Interview scene of a Blade Runner seems like a fun place to start testing the speech to speech pipeline of the scripting system.
In the video, we have:
Jetson Orin Nano Developer Kit: https://link.amazon/B0dQHrC1L
Roboco Panini case: https://link.amazon/B09IXoUaW
Reachy Mini Lite: https://store.pollen-robotics.com/collections/reachy-mini
Seeed: https://www.seeedstudio.com/Reachy-Mini-Lite-Kit-p-6702.html
Blade Runner 2049: https://link.amazon/B0j4qDiQf
Pale Fire by Vladimir Nabokov: https://link.amazon/B0hkXKG2H
The idea here is that we have a speech pipeline: speech to text (ASR) then processing then text to speech. In the processing loop, we have a scriptable element which allows working with the incoming stream and system resources to produce the text to speak. This script has a large collection of cues, which trigger a response when identified, such as "within cells interlinked". The actual text from the test is what the scene from Blade Runner 2049 is based on. This is inspired by Pale Fire by Vladimir Nabokov, which has a passage that serves as the baseline for the blade runner.
The Jetson Orin Nano is connected to a local area network wirelessly in able to access models running locally.
Amongst the models:
NVIDIA - Parakeet
Liquid AI - db1-3B
Gradium - Phonon
The male and female voices are both generated by Phonon and played through the Reachy Mini speaker.
As an Amazon Associate I earn from qualifying purchases.
Visit the JetsonHacks storefront on Amazon: https://www.amazon.com/shop/jetsonhacks
Visit the website at https://jetsonhacks.com
Sign up for the newsletter! https://newsletter.jetsonhacks.com
Github accounts: https://github.com/jetsonhacks
https://github.com/jetsonhacksnano
Twitter: http://twitter.com/jetsonhacks
Some of these links here are affiliate links. As an Amazon Associate I earn from qualifying purchases at no extra cost to you.
https://www.youtube.com/channel/UCQs0lwV6E4p7LQaGJ6fgy5Q/join
I always liked the Blade Runner movies, so recreating a Baseline Interview scene of a Blade Runner seems like a fun place to start testing the speech to speech pipeline of the scripting system.
In the video, we have:
Jetson Orin Nano Developer Kit: https://link.amazon/B0dQHrC1L
Roboco Panini case: https://link.amazon/B09IXoUaW
Reachy Mini Lite: https://store.pollen-robotics.com/collections/reachy-mini
Seeed: https://www.seeedstudio.com/Reachy-Mini-Lite-Kit-p-6702.html
Blade Runner 2049: https://link.amazon/B0j4qDiQf
Pale Fire by Vladimir Nabokov: https://link.amazon/B0hkXKG2H
The idea here is that we have a speech pipeline: speech to text (ASR) then processing then text to speech. In the processing loop, we have a scriptable element which allows working with the incoming stream and system resources to produce the text to speak. This script has a large collection of cues, which trigger a response when identified, such as "within cells interlinked". The actual text from the test is what the scene from Blade Runner 2049 is based on. This is inspired by Pale Fire by Vladimir Nabokov, which has a passage that serves as the baseline for the blade runner.
The Jetson Orin Nano is connected to a local area network wirelessly in able to access models running locally.
Amongst the models:
NVIDIA - Parakeet
Liquid AI - db1-3B
Gradium - Phonon
The male and female voices are both generated by Phonon and played through the Reachy Mini speaker.
As an Amazon Associate I earn from qualifying purchases.
Visit the JetsonHacks storefront on Amazon: https://www.amazon.com/shop/jetsonhacks
Visit the website at https://jetsonhacks.com
Sign up for the newsletter! https://newsletter.jetsonhacks.com
Github accounts: https://github.com/jetsonhacks
https://github.com/jetsonhacksnano
Twitter: http://twitter.com/jetsonhacks
Some of these links here are affiliate links. As an Amazon Associate I earn from qualifying purchases at no extra cost to you.
Category (YouTube): Science & Technology
Playback is via YouTube's official embedded player. Data from YouTube; Exumo is not affiliated with YouTube.