3.5 Model Serving & Inference Optimization

Serve models efficiently and optimize inference for speed, scale, and cost.

View 7 mapped courses Browse all courses

Courses

7 courses

Curated external courses related to Model Serving & Inference Optimization.

DeepLearning.AI

Fast & Efficient LLM Inference with vLLM

IntermediateUnknown

Model Serving & Inference Optimization

DeepLearning.AI

Efficient Inference with SGLang: Text and Image Generation

IntermediateUnknown

Model Serving & Inference Optimization

DeepLearning.AI

Quantization in Depth

IntermediateUnknown

Model Serving & Inference Optimization

DeepLearning.AI

Efficiently Serving LLMs

IntermediateUnknown

Model Serving & Inference Optimization

DeepLearning.AI

Quantization Fundamentals with Hugging Face

IntermediateUnknown

Model Serving & Inference Optimization

NVIDIA

Introduction to Deploying RAG Pipelines for Production at Scale

4h / $90

NVIDIA certification preparation / Self-paced

NVIDIA

Deploying RAG Pipelines for Production at Scale

8h / $500

NVIDIA certification preparation / Instructor-led / workshop