HighScore.ai
Capabilities/AI Platform Engineering

3.2 Pre-Training & Distributed Training

Use data, compute, and distributed methods to train foundation models at scale.

View 5 mapped coursesBrowse all courses

Courses

5 courses

Curated external courses related to Pre-Training & Distributed Training.

Stanford University

Stanford CS336: Language Modeling from Scratch

Intermediate10-week university course

language modeling / systems / model training

View course

DeepLearning.AI

Build and Train an LLM with JAX

IntermediateUnknown

Pre-Training & Distributed Training

View course

DeepLearning.AI

Intro to Federated Learning

IntermediateUnknown

Pre-Training & Distributed Training

View course

DeepLearning.AI

Pretraining LLMs

IntermediateUnknown

Pre-Training & Distributed Training

View course

NVIDIA

Model Parallelism: Building and Deploying Large Neural Networks

8h / $500

NVIDIA certification preparation / Instructor-led / workshop

View course