What if your local machine could run high-throughput LLMs, multimodal models, or even fine-tune small AI models with GPU acceleration? In this new episode of AI Guide to the Galaxy, Oleg sits down with Eric from the Docker Model Runner team to explore how the project is evolving to make all of that possible. 🎙️ In this episode: - How Docker Model Runner is expanding support for engines like VLLM and NVIDIA NIMs - Running models on AMD GPUs and integrated graphics via Vulkan - Using multimodal m
What if your local machine could run high-throughput LLMs, multim…
781 views3 months ago
FacebookDocker
LLama 2 LLM for PDF Invoice Data Extraction
LLama 2 LLM for PDF Invoice Data Extraction
22.4K viewsSep 25, 2023
YouTubeAndrej Baranovskij
LLM Jargons Explained: Part 4 - KV Cache
13:47
LLM Jargons Explained: Part 4 - KV Cache
10.5K viewsMar 24, 2024
YouTubeSachin Kalsi
vLLM: Easily Deploying & Serving LLMs
15:19
vLLM: Easily Deploying & Serving LLMs
21K views5 months ago
YouTubeNeuralNine
LLM Evaluation Basics: Datasets & Metrics
5:18
LLM Evaluation Basics: Datasets & Metrics
16.4K viewsJun 12, 2023
YouTubeGenerative AI at MIT
LM Studio: Run Local LLMs in 7 Minutes
6:47
LM Studio: Run Local LLMs in 7 Minutes
17K viewsMay 20, 2024
YouTubeDevelopers Digest
vLLM - Turbo Charge your LLM Inference
8:55
vLLM - Turbo Charge your LLM Inference
19.8K viewsJul 7, 2023
YouTubeSam Witteveen
5:13
What is LLM quantization?
26.3K viewsNov 6, 2023
YouTubeAirtrain AI
27:31
vLLM on Kubernetes in Production
8.9K viewsMay 17, 2024
YouTubeKubesimplify
4:35
How to tune LLMs in Generative AI Studio
313.1K viewsMay 3, 2023
YouTubeGoogle Cloud Tech
10:15
How to Implement RAG locally using LM Studio and AnythingLLM
19.3K viewsMay 29, 2024
YouTubeFahd Mirza
13:53
Generate LLM Embeddings On Your Local Machine
27K viewsJan 13, 2024
YouTubeNeuralNine
13:38
LLM evaluation basics: What, Why and How
5.3K views9 months ago
YouTubeBusiness Data Science with Delali
6:13
Optimize LLM inference with vLLM
9.9K views6 months ago
YouTubeRed Hat
5:57
Optimize for performance with vLLM
2.4K views9 months ago
YouTubeRed Hat
7:03
vLLM: Introduction and easy deploying
1.5K views2 months ago
YouTubeDigitalOcean
10:30
All You Need To Know About Running LLMs Locally
305.9K viewsFeb 26, 2024
YouTubebycloud
5:30
What are Large Language Models (LLMs)?
364.4K viewsMay 5, 2023
YouTubeGoogle for Developers
1:02:12
How to Build, Evaluate, and Iterate on LLM Agents
47.1K viewsDec 5, 2023
YouTubeDeepLearningAI
9:30
Setup vLLM with T4 GPU in Google Cloud
6.6K viewsAug 10, 2023
YouTubeCodeJet
6:10
Run LLMs Locally with Local Server (Llama 3 + LM Studio)
14.5K viewsMay 1, 2024
YouTubeCloud Data Science
25:20
Large Language Models (LLMs) - Everything You NEED To Know
428.1K viewsMar 7, 2024
YouTubeMatthew Berman
5:58
vLLM: AI Server with 3.5x Higher Throughput
17.6K viewsAug 10, 2024
YouTubeMervin Praison
15:48
02 - Exploring and comparing different LLM types
18.8K viewsOct 31, 2023
YouTubeMicrosoft Reactor
1:13:42
How the VLLM inference engine works?
10.1K views5 months ago
YouTubeVizuara
14:01
Deploy Open LLMs with LLAMA-CPP Server
24.7K viewsJun 10, 2024
YouTubePrompt Engineering
35:25
Containerizing LLM-Powered Apps: Part 1 of the Chatbot Deployment
20.9K viewsJul 28, 2023
YouTubeAI Anytime
4:33
Deploying vLLM from AMD Infinity Hub with AMD ROCm™ Software …
1.7K viewsJan 28, 2025
YouTubeAMD Developer Central
0:39
The 'v' in vLLM? Paged attention explained
6K views7 months ago
YouTubeRed Hat
1:01:11
vLLM: Virtual LLM #vllm #learnai
1.6K viewsDec 11, 2024
YouTubeAI Makerspace
See more videos
Static thumbnail place holder