Get Started With Your DGX Spark! | Setting Up LLMs & NIM

🔗 *The full guide* : _https://core-electronics.com.au/guides/applied-ai/getting-started-with-the-nvidia-dgx-spark-local-llms-and-nim/_

In this video, we are setting up the NVIDIA DGX Spark and having a little bit of a crash course into the world of locally hosted LLMs. We will be covering some basic concepts of LLMs while installing and setting up NIM - the engine that will run our AI models, as well as some LLMs and NVIDIA Sync - the app that will allow us to remotely work on our Spark. This is the first video in our series of guides setting up the DGX Spark, so stay tuned!

🔧🔨🧰 Hardware featured in this guide:

*NVIDIA DGX Spark:*
_https://core-electronics.com.au/catalog/product/view/sku/CE10915_
*NVIDIA Hardware:*
_https://core-electronics.com.au/f/nvidia-jetson.html_

💡❓ If you have any questions about this content or want to share a project you're working on head over to our *maker forum:* _http://coreelec.io/forum_

0:00 Intro
0:42 Installing Nvidia Sync
1:37 Installing Qwen3 32b
4:32 Sending Requests to Qwen3
7:04 Fixing the Excessive RAM Usage
11:12 Installing Nemotron Nano and Llama3.1
13:45 Explaining Quantisation
16:53 Wrapping it all up


🌏🦘 *Core Electronics* is located in the heart of Newcastle, Australia. We're powered by makers, for makers. Drop by if you are looking for:

• *Raspberry Pi* _https://core-electronics.com.au/raspberry-pi.html_
• *Arduino* _https://core-electronics.com.au/arduino.html_
• *Sparkfun* _https://core-electronics.com.au/brands/sparkfun-australia_
• *Adafruit* _https://core-electronics.com.au/brands/adafruit-australia_
• *Pololu* _https://core-electronics.com.au/brands/pololu-australia_
• *DFRobot* _https://core-electronics.com.au/brands/dfrobot-australia_

The following trademarks are owned by *Core Electronics Pty Ltd:*

"Core Electronics" and the Core Electronics logo
"Makerverse" and the Makerverse logo
"PiicoDev" and the PiicoDev logo
"GlowBit" and the GlowBit logo