Simon was working on a neural networks paper in Jupyter Notebook on Friday evening, but didn’t finish it because the Coding Train live stream started. He says he can no longer continue without having to do too much copy-pasting from this version into a new one, as his in-your-browser time expired, so I’m posting some screen shots of the unfinished paper below. This is the way Simon teaches himself: he follows lectures and tutorials online and then goes ahead to writing his own “textbook”or recording his own “lecture”. Much of the knowledge he acquires on neural networks these days comes from Siraj Raval’s YouTube series “The Math of Intelligence”.
Simon has already built a Perceptron before, several months ago, while following along with Daniel Sgiffman’s Coding Train channel. This time around, he is writing his own code ad doing all the matrix calculations himself. He hasn’t finished programming this network yet, but it’s a good start:
Doing Matrices in Khan Academy’s Precalculus course:
There’s a part 3 coming!
“Mom, my ClickCharts trial period expired, so I found this Virtual Paradigm Enterprise!” (Simon independently searches for free options to make beautiful diagrams online).
Here a diagram of an LSTM neural network:
And an RNN:
Simon’s second Live Stream today (in two parts, see the archived versions below) was a big success! He fixed the bug in his own Speechjs library (for speech recognition and speech synthesis), demonstrated it in action and (in the second part) created some awesome looking supershapes by morphing one supershape into another.
Please, vote for Simon’s speech recognition library on Strawpoll: https://strawpoll.com/e55esk3h
Simon loves looking at things geometrically. Even when solving word problems, he tends to see them as a graph. And naturally, since he started doing more math related to machine learning, graphs have occupied an even larger portion of his brain! Below are his notes in Microsoft Paint today (from memory):
Slope of Line:
Steepness of Curve:
An awesome calculator Simon discovered online at desmos.com/calculator that allows you to make mobile and static graphs:
Yesterday’s notes on the chi function (something he learned through 3Blue1Brown‘s videos on Taylor polynomials):
Simon following The Math of Intelligence course by Siraj Raval:
Pajama Lecture on Quarks, Leptons and Bosons (and a little bit on the Graviton):
Simon is trying to write a program for Sphere Morphing in Processing, first making a test code in p5.js (available here: https://alpha.editor.p5js.org/simontiger/sketches/S1zcwevkz)
In the video below, Simon is explaining the challenge using Magformers triangles:
Unfortunately, the test code doesn’t quite work yet: Simon is getting three infinite triangles around the circle.
Simon has been working on a large-scale project for a while, building his own editor that he called onoffline editor because it’s downloadable online. As always, the idea is totally Simon’s, all the text written on his own independently. The project is not finished yet, as Simon always works on several projects at a time, so I’m posting the intermediate status here:
Earlier stages of the same project:
Simon explaining how a Denoising Auto Encoder (DAE) neural network works: