AI Fundamentals
AI Fundamentals: a free course in 15 lessons on how AI works, from neural networks to today's language models. No maths or coding needed.
The lessons
- A short history of AI
- What a model is: data, functions and loss
- Learning by walking downhill: gradient descent
- Neurons, activations and networks
- Weights: what they physically are
- Backpropagation, training and inference
- Generalisation, overfitting and regularisation
- Representations, embeddings and tokens
- Attention and the transformer
- Pretraining, scaling and compute
- From base model to assistant: fine-tuning, RLHF and context
- Inference: sampling, cost and why repeated calls differ
- Evaluation, hallucination, interpretability and safety
- Where AI is now and where it is heading
- Capstone: LLMs as research instruments
This course needs JavaScript to run. From The Judgmentalism Project.