3.5 Model Serving & Inference Optimization

Serve models efficiently and optimize inference for speed, scale, and cost.

View 5 mapped courses Browse all courses

Courses

5 courses

Curated external courses related to Model Serving & Inference Optimization.

DeepLearning.AI

Fast & Efficient LLM Inference with vLLM

IntermediateUnknown

Model Serving & Inference Optimization

DeepLearning.AI

Efficient Inference with SGLang: Text and Image Generation

IntermediateUnknown

Model Serving & Inference Optimization

DeepLearning.AI

Quantization in Depth

IntermediateUnknown

Model Serving & Inference Optimization

DeepLearning.AI

Efficiently Serving LLMs

IntermediateUnknown

Model Serving & Inference Optimization

DeepLearning.AI

Quantization Fundamentals with Hugging Face

IntermediateUnknown

Model Serving & Inference Optimization