top of page



Ethan Smith
17 hours ago11 min read
There are probably a lot of special people.
One conviction I hold very strongly is that "special" people are possibly much more common than we may be lead to believe. While we are...
1 view
0 comments


Ethan Smith
Mar 147 min read
Minimum Faith
Within the study of machine learning, you'll often hear that the objective is to find the solution that maximizes likelihood . We have a...
38 views
0 comments

Ethan Smith
Mar 1310 min read
Softmax Attention is a Fluke
Calibrated Attention Calibrated Attention NanoGPT Attention is the magic ingredient of modern neural networks. It is the core of what has...
1,867 views
1 comment

Ethan Smith
Mar 113 min read
Kolmogorov Complexity
Mandelbrot function: Zn+1 = (Zn)^2 + C | Location: -1.4732524061369524549 + -0.0058138265122775765014 i , Radius:...
118 views
0 comments

Ethan Smith
Feb 127 min read
To create something new, you need to make some noise.
One of the most interesting things about the development of AI was the order of achieved milestones. Relatively small models can create...
273 views
0 comments

Ethan Smith
Jan 261 min read
How I like to think about diffusion
It's a bit hard to see in the diagram but in addition to being convolved with a gaussian, these points are also drifting close to zero....
79 views
0 comments

Ethan Smith
Jan 261 min read
Classifier free guidance and reinforcement learning
https://sweet-hall-e72.notion.site/Classifier-Free-Guidance-to-Approximate-RL-9f78c02801c6434da61f37c8d843c5bf
50 views
0 comments

Ethan Smith
Jan 1311 min read
The Tough Case for Free Will
"Would someone without free will do this?" is one of the most common responses I've heard to the proposition that free will might not...
91 views
0 comments


Ethan Smith
Jan 1210 min read
How absurd it is, that anything is at all.
Art from "In the Aeroplane over the Sea" by Neutral Milk Hotel There are several dimensions by which we may feel small. You may feel...
244 views
1 comment


Ethan Smith
Oct 18, 202412 min read
AI should help humans understand each other.
Empathy through technology
400 views
0 comments

Ethan Smith
Oct 6, 20241 min read
Why are Modern Neural Nets the way they are? And Hidden Hypernetworks.
https://sweet-hall-e72.notion.site/Why-are-Modern-Neural-Nets-the-way-they-are-And-Hidden-Hypernetworks-6c7195709e7b4abbada921875a951c54
142 views
0 comments

Ethan Smith
Jul 28, 20241 min read
Do Diffusion Transformers Deserve The Hype?
https://sweet-hall-e72.notion.site/Do-Diffusion-Transformers-Deserve-The-Hype-9b9ca7bead374b47aac96558714c203b
225 views
0 comments

Ethan Smith
May 26, 20241 min read
Automated LoRA Discovery and Teaching Neural Networks to make Neural Networks
https://sweet-hall-e72.notion.site/Automated-LoRA-Discovery-and-Teaching-Neural-Networks-to-make-Neural-Networks-22aa3b5ad66e4bc985ff2c93...
255 views
0 comments

Ethan Smith
May 21, 20241 min read
Diffusion and Autoregressive Models for Learning to Solve Mazes
https://sweet-hall-e72.notion.site/Diffusion-and-Autoregressive-Models-for-Learning-to-Solve-Mazes-c3bc4bcdfa304ecd9531ee5445a4da66
349 views
0 comments

Ethan Smith
May 12, 20241 min read
I Learn to Diffuse, or Data Alchemy 101: a Mnemonic Manifesto
https://arxiv.org/pdf/2208.03998
140 views
0 comments

Ethan Smith
May 6, 20241 min read
Traversing through CLIP Space, PCA and Latent Directions
https://sweet-hall-e72.notion.site/Traversing-through-CLIP-Space-PCA-and-Latent-Directions-b898932e13684d58957405b4a2747a79
1,676 views
0 comments

Ethan Smith
Apr 14, 20241 min read
LoraNorm
https://sweet-hall-e72.notion.site/LoraNorm-91f5927c7c3a48f9beeec7c2910c82ad?pvs=4
90 views
0 comments

Ethan Smith
Apr 14, 20241 min read
2 UNet Classifier Free Guidance
https://sweet-hall-e72.notion.site/2-UNet-Classifier-Free-Guidance-e2eb8833d01e4e77869a2eff4631ebbc?pvs=4
55 views
0 comments


Ethan Smith
Apr 14, 20241 min read
SGDImagePrompt and QuickEmbedding
https://sweet-hall-e72.notion.site/SGDImagePrompt-and-QuickEmbedding-502cf95e48ff4a4db44823e117b7f779?pvs=4
17 views
0 comments


Ethan Smith
Apr 14, 20241 min read
Learning Space Filling Curves with Autoencoders
https://sweet-hall-e72.notion.site/Learning-Space-Filling-Curves-with-Autoencoders-e39e41ce75894c3a8fecfee0f3bbfb23?pvs=4
89 views
0 comments
bottom of page