Make Your Own Private LLM Server | Ollama & WebUI on the DGX Spark

🔗 *The full guide* : _https://core-electronics.com.au/guides/applied-ai/how-to-set-up-ollama-and-open-webui-on-the-nvidia-dgx-spark/_

Previous Guide: https://youtu.be/4D2MaBUJ9gc

In this video, we will be setting up *Ollama and Open WebUI* on your *DGX Spark* to give you an offline and *private LLM experience* that should feel familiar to other browser-based LLMS. We will also be looking at where to source models from, explaining the *naming schemes* you will encounter, as well as going over some good principles on *how to choose a model.*

🔧🔨🧰 Hardware featured in this guide:

*DGX Spark:*
_https://core-electronics.com.au/catalog/product/view/sku/CE10915_
*NVIDIA:*
_https://core-electronics.com.au/nvidia.html_

💡❓ If you have any questions about this content or want to share a project you're working on head over to our *maker forum:* _http://coreelec.io/forum_

0:00 Intro
0:49 Setting up a Custom NVIDIA Sync App
1:25 Setting Up Ollama and Open WebUI
2:09 Downloading a Model
4:22 Taking a Look at What we Have
5:49 Explaining Some Model Naming Schemes
8:54 How to Choose a Model
11:10 Wrapping Things Up

🌏🦘 *Core Electronics* is located in the heart of Newcastle, Australia. We're powered by makers, for makers. Drop by if you are looking for:

• *Raspberry Pi* _https://core-electronics.com.au/raspberry-pi.html_
• *Arduino* _https://core-electronics.com.au/arduino.html_
• *Sparkfun* _https://core-electronics.com.au/brands/sparkfun-australia_
• *Adafruit* _https://core-electronics.com.au/brands/adafruit-australia_
• *Pololu* _https://core-electronics.com.au/brands/pololu-australia_
• *DFRobot* _https://core-electronics.com.au/brands/dfrobot-australia_

The following trademarks are owned by *Core Electronics Pty Ltd:*

"Core Electronics" and the Core Electronics logo
"Makerverse" and the Makerverse logo
"PiicoDev" and the PiicoDev logo
"GlowBit" and the GlowBit logo