Simon was working on a neural networks paper in Jupyter Notebook on Friday evening, but didn’t finish it because the Coding Train live stream started. He says he can no longer continue without having to do too much copy-pasting from this version into a new one, as his in-your-browser time expired, so I’m posting some screen shots of the unfinished paper below. This is the way Simon teaches himself: he follows lectures and tutorials online and then goes ahead to writing his own “textbook”or recording his own “lecture”. Much of the knowledge he acquires on neural networks these days comes from Siraj Raval’s YouTube series “The Math of Intelligence”.
There’s a part 3 coming!
“Mom, my ClickCharts trial period expired, so I found this Virtual Paradigm Enterprise!” (Simon independently searches for free options to make beautiful diagrams online).
Here a diagram of an LSTM neural network:
And an RNN:
Simon’s second Live Stream today (in two parts, see the archived versions below) was a big success! He fixed the bug in his own Speechjs library (for speech recognition and speech synthesis), demonstrated it in action and (in the second part) created some awesome looking supershapes by morphing one supershape into another.
Please, vote for Simon’s speech recognition library on Strawpoll: https://strawpoll.com/e55esk3h
Pajama Lecture on Quarks, Leptons and Bosons (and a little bit on the Graviton):
Simon explaining how a Denoising Auto Encoder (DAE) neural network works:
Here is Simon playing à quatre mains with his little sis, something he loves doing since she started piano lessons. She is not very keen on taking instructions, which upsets Simon enormously at times, but once they find the right tempo together, our whole world fills up with most beautiful vibes, making their loving friendship even more special.
This is the archived version of Simon’s first live stream. It went really well, even though Simon’s code didn’t function together with his Speechjs library. Simon didn’t panic and showed enough perseverance to try several solutions, to make sure that his library wasn’t broken and that he had enough time left to go through the presentation he had prepared in Google Docs. I was also presently surprised to see/ hear how elegantly he communicated during the social interactions with his viewers (yes, there were viewers!)
The next live stream will be on Thursday, November 16. Simon will be happy if you drop in on our channel!
Daniel Shiffman in Simon’s live chat!
Today is a big day as – for the first time in human history – a short story has been published that was written by a robot together with a human. And the bot (called AsiBot, because it writes in the style of Isaac Asimov’s I, Robot) was developed in Dutch (!) in Amsterdam (at Meertens Institute) and in Antwerp (at the Antwerp Centre for Digital Humanities and Literary Criticim), Simon’s two home cities.
The story written by the AsiBot and Dutch bestselling author Ronald Giphart forms a new, 10th chapter in Isaac Asimov’s classic I, Robot (that originally contained only 9 chapters). The AsiBot was fed 10 thousand books in Dutch to master the literary language and can already produce a couple of paragraphs on its own, but a longer coherent story remains out of fetch. This is where a human writer, Ronald Giphart stepped in. It was he who decided which of the sentences written by AsiBot stayed and which should be thrown out. The reader doesn’t know which sentences are written (or edited) by the human writer and which are pure robot literature. Starting from November 6 anyone (speaking Dutch) can try writing with AsiBot on www.asibot.nl.
Simon was very excited about this news and recorded a short video where he explains how such “synthetic literature”neural nets work (based on what he learned from Siraj Raval’s awesome YouTube classes):
My phone froze so we had to make the second part as a separate video:
When instead of a bed time story, your child insists upon teaching you gradient descent: