Writing
See all →- Vibe rot Refreshments are available in the lobby 10 minutes
- Refactoring a Deity It's an old plot twist: "Wait! We've been here before" 4 minutes
- LLMs Part 6: Building GPT-2 Refactoring our hand-written GPT-1 into GPT-2, exploring the optimisations needed to train at this scale on rented GPU hardware. 15 minutes
- LLMs Part 5: Tokenisation In this post, I explore 3 different tokenisation approaches and show you the outcome of each as they are subtly different. 8 minutes
- LLMs Part 4: Transformer Architecture This post is Part 4 in this series, where I try to teach myself the very basics of language modelling. 12 minutes
- LLMs Part 3: Building an LSTM This post is part 3 in a series where I attempted to teach myself the very basics of language modelling. 5 minutes
- LLMs Part 2: Building a Vanilla RNN This post is part 2 in a series where I attempted to teach myself the very basics of language modelling. 6 minutes
- Future of the Industries Dispatches from a construction-tech conference 13 minutes
- LLMs Part 1: Building Word2Vec This is Part 1 of a series I'm writing about LLMs and natural language models. 9 minutes
- When We Travel Observations from airplane mode 3 minutes
- What Comes Next? So, AI has arrived! The big hoohah is here. And now what? 1 minute
- Mysteries & Magics A long list of loose threads to pull upon 12 minutes
- AI and the Age of Aquarius The vibe shift in our stars 3 minutes
