HighScore.ai
Capabilities/AI Platform Engineering

3.2 Pre-Training & Distributed Training

Use data, compute, and distributed methods to train foundation models at scale.

Courses

4 courses

Curated external courses related to Pre-Training & Distributed Training.

Stanford University

Stanford CS336: Language Modeling from Scratch

Intermediate10-week university course

language modeling / systems / model training

View course

DeepLearning.AI

Build and Train an LLM with JAX

IntermediateUnknown

Pre-Training & Distributed Training

View course

DeepLearning.AI

Intro to Federated Learning

IntermediateUnknown

Pre-Training & Distributed Training

View course

DeepLearning.AI

Pretraining LLMs

IntermediateUnknown

Pre-Training & Distributed Training

View course