Foundations of AI

Building a clear understanding of the fundamental concepts behind modern AI systems.


Perceptrons

Part 1 of 3 in Foundations of AI

An overview of Rosenblatt’s 1958 perceptron — how it works, where it fails, and its influence on modern neural networks.

— Written 28 July 2025 · Edited 04 August 2025 · Written by Benjamin Clark

Activation Functions

Part 2 of 3 in Foundations of AI

Activation functions explained: their role in neural network learning, evolution from step functions to ReLU and beyond, and why non‑linearity enables deep learning.

— Written 05 August 2025 · Written by Benjamin Clark

Multi-layer Perceptrons and Backpropagation

Part 3 of 3 in Foundations of AI

MLPs and backpropagation: how deep networks learn by stacking non-linear layers—and where they struggle.

— Written 28 August 2025 · Written by Benjamin Clark