Speech AI on Jetson Tutorial

Full article on JetsonHacks.com: https://wp.me/p7ZgI9-3LZ

This is an involved installation process, hence the video. Beginners might find this difficult.

RIVA Quick Start Guide: https://docs.nvidia.com/deeplearning/riva/user-guide/docs/quick-start-guide.html
NGC: https://ngc.nvidia.com
NGC CLI Tool: https://ngc.nvidia.com/setup/installers/cli
RIVA Python Clients: https://github.com/nvidia-riva/python-clients

Videos:
Sign up for NGC and Generate API Key: https://youtu.be/yBNt4qSnn0k
ngc config set walkthrough : https://youtu.be/LN5NzKx3qf0

RIVA is a SDK for developing conversational AI Speech. RIVA can run on-device without the need for an Internet connection. There are a couple of undocumented pitfalls in the installation process which we cover here. The full set of commands that we executed are in the JetsonHacks article.

RIVA is a comprehensive library with includes:
• Automated speech recognition (ASR)
• Text-to-Speech synthesis (TTS)
• Neural Machine Translation (NMT) (language to language translation)
• A collection of natural language processing (NLP) services, such as named entity recognition (NER), punctuation, and intent classification.

Here we install the RIVA SDK on a NVIDIA Jetson Orin Nano Developer Kit. If you are using this device, make sure that the QSPI memory has been updated properly. The available memory should be ~ 7.2 GB. This install can be a little challenging on this 8GB device, as RIVA and models take ~ 6.8GB.

RIVA is in beta release on the Jetsons, and the instructions here may need to be changed to work in future releases. RIVA works on the NVIDIA AGX Orin, Orin NX and Orin Nano. RIVA also works on the NVIDIA AGX Xavier and Xavier NX. You must have 8GB+ to follow along with the demo in the video. RIVA requires JetPack 5 or above.

Equipment in video:
NVIDIA Jetson Orin Nano Developer Kit: https://amzn.to/3YnMl8Q
Logitech Headset with microphone: https://amzn.to/3OWK1CN
The Laws of Human Nanture - Robert Greene : https://amzn.to/3YsS7pJ

Kamala Harris Motivational Poster: https://thefederalist.com/2022/03/15/kamala-harris-quotes-as-motivational-posters-because-the-time-to-be-inspired-is-every-day/

Amazon JetsonHacks Storefront: https://www.amazon.com/shop/jetsonhacks
Website: http://jetsonhacks.com
Sign up for the newsletter! https://newsletter.jetsonhacks.com
Github: https://github.com/jetsonhacks
Github: https://github.com/jetsonhacksnano
X: http://twitter.com/jetsonhacks

Some of these links here are affiliate links. As an Amazon Associate I earn from qualifying purchases at no extra cost to you.