Simon working on a neural networks paper

Simon was working on a neural networks paper in Jupyter Notebook on Friday evening, but didn’t finish it because the Coding Train live stream started. He says he can no longer continue without having to do too much copy-pasting from this version into a new one, as his in-your-browser time expired, so I’m posting some screen shots of the unfinished paper below. This is the way Simon teaches himself: he follows lectures and tutorials online and then goes ahead to writing his own “textbook”or recording his own “lecture”. Much of the knowledge he acquires on neural networks these days comes from Siraj Raval’s YouTube series “The Math of Intelligence”.


Neural Networks Paper Jupyter 2017-11-20 1

Neural Networks Paper Jupyter 2017-11-20 2

Neural Networks Paper Jupyter 2017-11-20 3

Neural Networks Paper Jupyter 2017-11-20 4


Simon building a Perceptron in Processing

Simon has already built a Perceptron before, several months ago, while following along with Daniel Sgiffman’s Coding Train channel. This time around, he is writing his own code ad doing all the matrix calculations himself. He hasn’t finished programming this network yet, but it’s a good start:



Doing Matrices in Khan Academy’s Precalculus course:

Schermafbeelding 2017-11-16 om 12.34.36

Simon’s bedtime lectures on neural networks



There’s a part 3 coming!



“Mom, my ClickCharts trial period expired, so I found this Virtual Paradigm Enterprise!” (Simon independently searches for free options to make beautiful diagrams online).

Here a diagram of an LSTM neural network:

LSTM Cell in Virtual Paradigm Enterprise 19 Nov 2017 2

And an RNN:

RNN Cell in Virtual Paradigm Enterprise 19 Nov 2017

Simon’s Live Streams (Speechjs and Supershape Morphing)

Simon’s second Live Stream today (in two parts, see the archived versions below) was a big success! He fixed the bug in his own Speechjs library (for speech recognition and speech synthesis), demonstrated it in action and (in the second part) created some awesome looking supershapes by morphing one supershape into another.

Please, vote for Simon’s speech recognition library on Strawpoll:

Just another day in graphs

Simon loves looking at things geometrically. Even when solving word problems, he tends to see them as a graph. And naturally, since he started doing more math related to machine learning, graphs have occupied an even larger portion of his brain! Below are his notes in Microsoft Paint today (from memory):

Slope of Line:

Slope of Line 15 November 2017

Steepness of Curve:

Steepness of Curve 15 November 2017

An awesome calculator Simon discovered online at that allows you to make mobile and static graphs: Polynomial 15 Nov 2017 Polynomial 15 Nov 2017 1

Yesterday’s notes on the chi function (something he learned through 3Blue1Brown‘s videos on Taylor polynomials):


Simon following The Math of Intelligence course by Siraj Raval:



Sphere Morphing in Processing

Simon is trying to write a program for Sphere Morphing in Processing, first making a test code in p5.js (available here:

In the video below, Simon is explaining the challenge using Magformers triangles:


Unfortunately, the test code doesn’t quite work yet: Simon is getting three infinite triangles around the circle.

Simon building P5 onoffline editor

Simon has been working on a large-scale project for a while, building his own editor that he called onoffline editor because it’s downloadable online. As always, the idea is totally Simon’s, all the text written on his own independently. The project is not finished yet, as Simon always works on several projects at a time, so I’m posting the intermediate status here:



Earlier stages of the same project: