Automatic differentiation

◀ Prev | 2025-11-03, access: $ Basic | Next ▶

Video basics math theory training Training a machine learning model is one case of the larger class of "optimization" problems; to solve it, you need to calculate how the output (i.e. the loss) changes in relation to inputs (such as weights). I introduce the calculus topic of the derivative, and discuss how to calculate the derivative of a piece of software by augmenting the compiler or interpreter to do it during execution.

Click here to log in to your account, or here to sign up for a free account.