In my preceding YouTube videos, we detailed exactly what the gradient of cost is. With that understanding, today we dig into what it means to *descend* this gradient and fit a machine learning model.
We publish a new video from my "Calculus for Machine Learning" course to YouTube every Wednesday. Playlist is here.
More detail about my broader "ML Foundations" curriculum and all of the associated open-source code is available in GitHub here.
Filtering by Category: Calculus
The Gradient of Quadratic Cost
In this week's video, we derive the Partial Derivatives of Quadratic Cost with respect to the parameters of a simple regression model. This derivation is essential to understanding how machines learn via Gradient Descent.
We publish a new video from my "Calculus for Machine Learning" course to YouTube every Wednesday. Playlist is here.
More detail about my broader "ML Foundations" curriculum and all of the associated open-source code is available in GitHub here.
Linear Regression Fit Point by Point
With this new video, the past months of my "Calculus for Machine Learning" videos all start to come together, enabling us to apply the simplest ML model: a regression line fit to individual data points one by one by one.
This simple regression model will enable us, in next week's video, to derive the simplest-possible partial derivatives for calculating a machine learning gradient.
We publish a new video from my "Calculus for Machine Learning" course to YouTube every Wednesday. Playlist is here.
More detail about my broader "ML Foundations" curriculum and all of the associated open-source code is available in GitHub here.
Exercises on the Multivariate Chain Rule
Last week's YouTube video detailed how we use the Chain Rule for Multivariate (Partial Derivative) Calculus. This week's video features three exercises to test your comprehension of the topic.
We publish a new video from my "Calculus for Machine Learning" course to YouTube every Wednesday. Playlist is here.
More detail about my broader "ML Foundations" curriculum and all of the associated open-source code is available in GitHub here.
The Chain Rule for Partial Derivatives
For this week's YouTube video, we apply the Chain Rule (introduced earlier in the series in the single-variable case) to find the partial derivatives of multivariate functions — such as Machine Learning functions!
We publish a new video from my "Calculus for Machine Learning" course to YouTube every Wednesday. Playlist is here.
More detail about my broader "ML Foundations" curriculum and all of the associated open-source code is available in GitHub here.
Partial Derivative Notation
This week's YouTube video is a quick one on the common options for partial derivative notation.
We publish a new video from my "Calculus for Machine Learning" course to YouTube every Wednesday. Playlist is here.
More detail about my broader "ML Foundations" curriculum and all of the associated open-source code is available in GitHub here.
"Math for Machine Learning" course on Udemy complete!
After a year of filming and editing, my "Math for Machine Learning" course on Udemy is complete! To celebrate, we put together this epic video that overviews the 15-hour curriculum in under two minutes.
Over 83,000 students have registered for the course, which provides an introduction to all of the essential Linear Algebra and Calculus that one needs to be an expert Machine Learning practitioner. It's full of hundreds of hands-on code demos in the key Python tensor libraries — NumPy, TensorFlow, and PyTorch — to make learning fun and intuitive.
You can check out the course here.
Advanced Partial-Derivative Exercises
My "Machine Learning Foundations" video this week features fun geometrical examples in order to strengthen your command of the partial derivative theory that we covered in the preceding videos.
We publish a new video from my "Calculus for Machine Learning" course to YouTube every Wednesday. Playlist is here.
More detail about my broader "ML Foundations" curriculum and all of the associated open-source code is available in GitHub here.
Advanced Partial Derivatives
This week's video builds on the preceding ones in my ML Foundations series to advance our understanding of partial derivatives by working through geometric examples. We use paper and pencil as well as Python code.
We publish a new video from my "Calculus for Machine Learning" course to YouTube every Wednesday. Playlist is here.
More detail about my broader "ML Foundations" curriculum and all of the associated open-source code is available in GitHub here.
Calculating Partial Derivatives with PyTorch AutoDiff
My recent videos have detailed how to calculate partial derivatives by hand. In today's, I demo how we can compute them automatically using PyTorch, enabling us to easily differentiate complex equations like ML models.
We publish a new video from my "Calculus for Machine Learning" course to YouTube every Wednesday. Playlist is here.
More detail about my broader "ML Foundations" curriculum and all of the associated open-source code is available in GitHub here.
Partial Derivative Exercises
Last week's YouTube tutorial was an epic intro to Partial Derivative Calculus — a critical foundation for understanding Machine Learning. This week's video features coding exercises that test your comprehension of that material.
We publish a new video from my "Calculus for Machine Learning" course to YouTube every Wednesday. Playlist is here.
More detail about my broader "ML Foundations" curriculum and all of the associated open-source code is available in GitHub here.
What Partial Derivatives Are
Here is my brand-new 30-minute intro to Partial Derivative Calculus. To make comprehension as easy as possible, we use colorful illustrations, hands-on code demos in Python, and an interactive click-and-point curve-plotting tool.
This is an epic video covering a massively foundational topic underlying nearly all statistical and machine learning approaches. I hope you enjoy it!
We publish a new video from my "Calculus for Machine Learning" course to YouTube every Wednesday. Playlist is here.
More detail about my broader "ML Foundations" curriculum and all of the associated open-source code is available in GitHub here.
Calculus II: Partial Derivatives & Integrals – Subject 4 of Machine Learning Foundations
Every few months, we begin a new subject in my Machine Learning Foundations course on YouTube and today is one of those days! This video introduces Subject 4 (of 8), which covers Partial Derivatives and Integrals.
This subject-intro video provides a preview of all the content that will be covered in this subject. It also reviews the Single-Variable Calculus you need to be familiar with (from the preceding subject in the ML Foundation series) in order to understand Partial Derivatives (a.k.a. Multi-Variable Calculus).
The thumbnail illustration of my ever-learning puppy Oboe is by the wonderful artist Aglae Bassens.
We publish a new video from my "Calculus for Machine Learning" course to YouTube every Wednesday. Playlist is here.
More detail about my broader "ML Foundations" curriculum and all of the associated open-source code is available in GitHub here.
Machine Learning from First Principles, with AutoDiff
Today's brand-new, epic 40-minute YouTube tutorial ties together the preceding 27 Calculus videos to enable us to perform Machine Learning from first principles and fit a line to data points.
To make learning interactive and intuitive, this video focuses on hands-on code demos featuring PyTorch, the popular Python library for Automatic Differentiation.
If you're familiar with differential calculus but not machine learning, this video will make clear for you how ML works. If you're not familiar with differential calculus, the preceding videos in my "Calculus for Machine Learning" course will provide you with all of the foundational theory you need for ML.
We publish a new video from my "Calculus for Machine Learning" course to YouTube every Wednesday. Playlist is here.
More detail about my broader "ML Foundations" curriculum and all of the associated open-source code is available in GitHub here.
O'Reilly + JK October ML Foundations LIVE Classes open for registration
The Linear Algebra classes of my "ML Foundations" curriculum, offered via the O'Reilly Media platform, are in the rear-view mirror. Two Calculus classes are coming up soon and the Probability classes just opened for registration:
• Sep 15 — Calculus III: Partial Derivatives
• Sep 22 — Calculus IV: Gradients and Integrals
• Oct 6 — Intro to Probability
• Oct 13 — Probability II and Information Theory
• Oct 27 — Intro to Statistics
Overall, four subject areas are covered:
• Linear Algebra (3/3 classes DONE)
• Calculus (2/4 classes DONE)
• Probability and Statistics (4 classes)
• Computer Science (3 classes)
Hope to see you in class! Sign up opens about two months prior to each class. All of the training dates and registration links are provided at jonkrohn.com/talks
A detailed curriculum and all of the code for my ML Foundations series is available open-source in GitHub here.
The Line Equation as a Tensor Graph
New YouTube video today — it's meaty! In it, we get ourselves set up for applying Machine Learning from scratch by using the popular Python library PyTorch to create a Tensor Graph representation of a simple line equation.
Next week, we'll publish a massive 40-minute video that builds on the Tensor Graph representation introduced this week in order to use Automatic Differential Calculus within a Machine Learning loop and fit a Regression line to data points.
If you're familiar with differential calculus but not machine learning, this pair of videos will fill in all the gaps for you on how ML works. If you're not familiar with differential calculus, the preceding videos in my "Calculus for Machine Learning" course will provide you with all of the foundational theory you need for ML.
We publish a new video from my "Calculus for Machine Learning" course to YouTube every Wednesday. Playlist is here.
More detail about my broader "ML Foundations" curriculum and all of the associated open-source code is available in Github here.
AutoDiff with TensorFlow
PyTorch and TensorFlow are by far the two most widely-used automatic-differentiation libraries. Last week, we used PyTorch to differentiate an equation automatically and instantaneously. Today, we do it with TensorFlow.
(For an overview of the pros and cons of PyTorch versus TensorFlow, I've got a talk here. The TLDR is you should know both!)
A new video for my "Calculus for ML" course published on YouTube every Wednesday. Playlist is here.
More detail about my broader "ML Foundations" curriculum and all of the associated open-source code is available in GitHub here.
AutoDiff with PyTorch
Over the past month, we've covered all the key rules for differentiating equations by hand. In today's YouTube video, we use PyTorch to differentiate equations automatically and instantaneously.
A new video for my "Calculus for ML" course published on YouTube every Wednesday. Playlist is here.
More detail about my broader "ML Foundations" curriculum and all of the associated open-source code is available in GitHub here.
AutoDiff Explained
New YouTube video live! This one introduces what Automatic Differentiation — a technique that allows us to scale up the computation of derivatives to machine-learning scale — is.
A new video for my "Calculus for ML" course published on YouTube every Wednesday. Playlist is here.
More detail about my broader "ML Foundations" curriculum and all of the associated open-source code is available in GitHub here.
Automatic Differentiation – Segment 3 of Subject 3, "Limits & Derivatives" – Machine Learning Foundations
Automatic Differentiation is a computational technique that allows us to move beyond calculating derivatives by hand and scale up the calculation of derivatives to the massive scales that are common in machine learning.
The YouTube videos in this segment, which we'll release every Wednesday, introduce AutoDiff in the two most important Python AutoDiff libraries: PyTorch and TensorFlow.
My growing "Calculus for ML" course is available on YouTube here.
More detail about my broader "ML Foundations" curriculum and all of the associated open-source code is available in GitHub here.