NVIDIA NIM Beginners Tutorial - Create Datasets Fast with Llama 3.1

Python Simplified β€’ August 28, 2024
Video Thumbnail
Python Simplified Logo

Python Simplified

@pythonsimplified

About

Hi everyone! My name is Mariya and I'm a software developer from Sofia, Bulgaria. I film programming tutorials about Computer Science Concepts, GUI Applications, Machine Learning and Artificial Intelligence, Automation and Web Scraping, Data Science and even Math! πŸ€“ I'm here to help you with your programming journey (in particular - your Python programming journey πŸ˜‰) and show you how many beautiful and powerful things we can do with code! πŸ’ͺπŸ’ͺπŸ’ͺ

Video Description

In this tutorial, we will explore the newly announced NVIDIA NIM platform and use it to create our very own Llama 3.1 Powered Application! 🀩🀩🀩 Specifically, we will dive into NIM's collection of inference microservices, and state of the art APIs! (it's OK if you're not sure what it means yet, I explain it in the video πŸ˜‰) The end result, is your own Custom Dataset Maker App that you can adjust and enhance with a little bit of Python! πŸ€“ This video is perfect for beginners, as I explain all the advanced AI concepts in simple language and with plenty of visual examples. It is also perfect for professionals, as I show you how to skip the entire AI pipeline setup with the help of NIM. ⭐ Checkout the NIM API Catalog Here: https://nvda.ws/3KaExRD ⏰ Timestamps ⏰ ------------------------------------------------------------------------------------------ 00:00 - intro 00:38 - what is NVIDIA NIM? 00:55 - what are microservices? 01:20 - microservices challenges 01:42 - NIM benefits 02:30 - NIM components 03:11 - what is an API? 03:54 - NIM API Catalog demo 05:10 - NIM deployment options 06:45 - generate NGC API KEY 07:51 - deploy NIM container 09:03 - model health check 09:31 - run basic Llama prompt code 10:37 - a heavy metal song about job search 11:09 - Llama request object 12:29 - Llama response object 13:40 - chain a series of prompts 16:22 - convert prompt response to list 17:45 - save custom dataset to CSV 18:14 - thanks for watching! πŸš€ My Brev Launchable - Dataset Maker Notebook πŸš€ ------------------------------------------------------------------------------------------ https://console.brev.dev/launchable/deploy?userID=gryyl1ate&orgID=ul7qvw3az&name=dataset_maker&instance=A100%40a2-ultragpu-1g%3Anvidia-a100-80gb%3A1&diskStorage=500&cloudID=GCP&baseImage=nvcr.io%2Fnvidia%2Fnemo%3A24.05.01&file=https%3A%2F%2Fgithub.com%2FMariyaSha%2FLlama3.1_DatasetMaker%2Fblob%2Fmain%2FLlama3.1_dataset_maker_brevdev.ipynb&launchableID=env-2kZVjyRCFgLo4X6SDhVoQSJn5Ux πŸ“Ί Related Tutorials of MineπŸ“Ί ------------------------------------------------------------------------------------------ ⭐ CUDA For Beginners: https://youtu.be/r9IqwpMR9TE ⭐ Docker Containers Simply Explained: https://youtu.be/-l7YocEQtA0 🀝 Connect with me 🀝 ------------------------------------------------------------------------------------------ πŸ”— Github: https://github.com/mariyasha πŸ”— X: https://x.com/MariyaSha888 πŸ”— LinkedIn: https://ca.linkedin.com/in/mariyasha888 πŸ”— Blog: https://www.pythonsimplified.org πŸ”— Discord: https://discord.com/invite/wgTTmsWmXA πŸ’³ Credits πŸ’³ ------------------------------------------------------------------------------------------ ⭐ Beautiful titles, transitions, sound FX: mixkit.co ⭐ Beautiful Icons: flaticon.com ⭐ Beautiful Thumbnail: Grok and Firefly #ai #artificialintelligence #ml #machinelearning #dl #deeplearning #largelanguagemodels #llm #llama #nvidia #python #pythontutorial #pythontutorialforbeginners #pythonforbeginners #learnpython #learning #coding #programming #software #softwareengineer #softwaredevelopment #microservicesarchitecture #microservices #api #container #docker #server #dataset #datascience #computerscience #technology #tech #prompting #application #pythoncoding #tutorial #codingtutorial #jupyternotebook #vscode #cloudcomputing #inference #prediction

You May Also Like

Essential NVIDIA Tools

AI-recommended products based on this video

Loading...
for 90MM Video Card Cooler Fan for GPU for MSI GeForce for RTX 3060 3070 3080 3090 3060Ti 3070TI for Gaming X Trio Graphics(1pcs)

for 90MM Video Card Cooler Fan for GPU for MSI GeForce for RTX 3060 3070 3080 3090 3060Ti 3070TI for Gaming X Trio Graphics(1pcs)

(0)
$38.13
FREE delivery Mar 19 - Apr 10
Loading...
Samsung 990 EVO Plus - 4TB PCIe Gen4. X4, Gen5. X2 NVMe 2.0 - M.2 Internal SSD, Speed Up to 7,250 MBs, Upgrade Storage for PC-Laptops, HMB Technology and Intelligent Turbowrite (MZ-V9S4T0B/AM)

Samsung 990 EVO Plus - 4TB PCIe Gen4. X4, Gen5. X2 NVMe 2.0 - M.2 Internal SSD, Speed Up to 7,250 MBs, Upgrade Storage for PC-Laptops, HMB Technology and Intelligent Turbowrite (MZ-V9S4T0B/AM)

(1,811)
$359.99$341.99
FREE delivery Tue, Jun 17
100+ bought in past month
Loading...
Apple 2025 MacBook Air 13-inch Laptop with M4 chip: Built for Apple Intelligence, 16GB Unified Memory, 256GB SSD Storage, Touch ID; Sky Blue - English Keyboard

Apple 2025 MacBook Air 13-inch Laptop with M4 chip: Built for Apple Intelligence, 16GB Unified Memory, 256GB SSD Storage, Touch ID; Sky Blue - English Keyboard

(687)
$1,249.99
PrimeFREE delivery Sat, Jun 14
100+ bought in past month
Loading...
SAMSUNG 870 EVO SATA SSD 500GB 2.5” Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E500B/AM [Canada Version]

SAMSUNG 870 EVO SATA SSD 500GB 2.5” Internal Solid State Drive, Upgrade PC or Laptop Memory and Storage for IT Pros, Creators, Everyday Users, MZ-77E500B/AM [Canada Version]

(41,678)
$74.97
FREE delivery Wed, Jun 18
400+ bought in past month
Loading...
Crucial X10 Pro 4TB Portable SSD, Up to 2100MB/s Read, 2000MB/s Write, 3.2 USB-C, External Solid State Drive, Durable Storage for PC & Mac, for Professional Creators, Black - β€ŽCT4000X10PROSSD902

Crucial X10 Pro 4TB Portable SSD, Up to 2100MB/s Read, 2000MB/s Write, 3.2 USB-C, External Solid State Drive, Durable Storage for PC & Mac, for Professional Creators, Black - β€ŽCT4000X10PROSSD902

(2,557)
$358.93
FREE delivery Tue, Jun 17
50+ bought in past month
Loading...
Skytech Blaze 3.0 Gaming PC Desktop – Intel Core i5 12400F 2.5 GHz, NVIDIA RTX 3060, 500GB NVME SSD, 16GB DDR4 RAM 3200, 600W Gold PSU, 11AC Wi-Fi, Windows 11 Home 64-bit

Skytech Blaze 3.0 Gaming PC Desktop – Intel Core i5 12400F 2.5 GHz, NVIDIA RTX 3060, 500GB NVME SSD, 16GB DDR4 RAM 3200, 600W Gold PSU, 11AC Wi-Fi, Windows 11 Home 64-bit

(786)
$1,414.11
FREE delivery Thu, Feb 19Only 4 left in stock.
Loading...
Seasonic Focus V4 GX-1000 (ATX3) - 1000W - 80+ Gold - ATX 3.0 & PCIe 5.1 Ready -Full-Modular -ATX Form Factor -Premium Japanese Capacitor -10 Year Warranty -Nvidia RTX 30/40 Super & AMD GPU Compatible

Seasonic Focus V4 GX-1000 (ATX3) - 1000W - 80+ Gold - ATX 3.0 & PCIe 5.1 Ready -Full-Modular -ATX Form Factor -Premium Japanese Capacitor -10 Year Warranty -Nvidia RTX 30/40 Super & AMD GPU Compatible

(22)
$423.35
FREE delivery Oct 8 - 10
Loading...
Skytech Legacy Gaming PC Desktop, Ryzen 7 9800X3D 4.7 GHz (5.2 GHz Turbo Boost), NVIDIA RTX 5080 16GB GDDR7, 1TB Gen4 SSD, 32GB DDR5 RAM 6000 RGB, 1000W Gold ATX 3.0 PSU, 360 ARGB AIO, Wi-Fi, Win 11

Skytech Legacy Gaming PC Desktop, Ryzen 7 9800X3D 4.7 GHz (5.2 GHz Turbo Boost), NVIDIA RTX 5080 16GB GDDR7, 1TB Gen4 SSD, 32GB DDR5 RAM 6000 RGB, 1000W Gold ATX 3.0 PSU, 360 ARGB AIO, Wi-Fi, Win 11

(9)
$3,950.00$3,752.50
FREE delivery Wed, Jun 18