Something I've been thinking about a lot lately is how humans handle noisy recognition. Maybe you recognize the image above, if not you...

The Psychiatrist's Office Once upon a time, I was set on becoming a psychiatrist. I had always been deeply interested in psychology....

The Distillery - a look under the hood of vibe coding Introduction Vibe coding may be one of the best and worst things 2025 has had to...

I’ve seen a lot of convoluted tutorials on attention but nothing really made it click for me more as understanding as mixing a projected...

One conviction I hold very strongly is that "special" people are possibly much more common than we may be lead to believe. While sure, we...

Presently, most optimizers used in deep learning do not explicitly accommodate their updates with respect to the expected range of...

Within the study of machine learning, you'll often hear that the objective is to find the solution that maximizes likelihood . We have a...

Calibrated Attention Calibrated Attention NanoGPT Attention is the magic ingredient of modern neural networks. It is the core of what has...

Mandelbrot function: Zn+1 = (Zn)^2 + C | Location: -1.4732524061369524549 + -0.0058138265122775765014 i , Radius:...

One of the most interesting things about the development of AI was the order of achieved milestones. Relatively small models can create...

It's a bit hard to see in the diagram but in addition to being convolved with a gaussian, these points are also drifting towards zero....

https://sweet-hall-e72.notion.site/Classifier-Free-Guidance-to-Approximate-RL-9f78c02801c6434da61f37c8d843c5bf

"Would someone without free will do this?" is one of the most common responses I've heard to the proposition that free will might not...

Art from "In the Aeroplane over the Sea" by Neutral Milk Hotel There are several dimensions by which we may feel small. You may feel...

Empathy through technology

https://sweet-hall-e72.notion.site/Why-are-Modern-Neural-Nets-the-way-they-are-And-Hidden-Hypernetworks-6c7195709e7b4abbada921875a951c54

https://sweet-hall-e72.notion.site/Do-Diffusion-Transformers-Deserve-The-Hype-9b9ca7bead374b47aac96558714c203b

https://sweet-hall-e72.notion.site/Automated-LoRA-Discovery-and-Teaching-Neural-Networks-to-make-Neural-Networks-22aa3b5ad66e4bc985ff2c93...

https://sweet-hall-e72.notion.site/Diffusion-and-Autoregressive-Models-for-Learning-to-Solve-Mazes-c3bc4bcdfa304ecd9531ee5445a4da66

https://arxiv.org/pdf/2208.03998