top of page
Ethan Smith
Jan 261 min read
How I like to think about diffusion
It's a bit hard to see in the diagram but in addition to being convolved with a gaussian, these points are also drifting close to zero....
10 views0 comments
Ethan Smith
Jan 261 min read
Classifier free guidance and reinforcement learning
https://sweet-hall-e72.notion.site/Classifier-Free-Guidance-to-Approximate-RL-9f78c02801c6434da61f37c8d843c5bf
11 views0 comments
Ethan Smith
Oct 6, 20241 min read
Why are Modern Neural Nets the way they are? And Hidden Hypernetworks.
https://sweet-hall-e72.notion.site/Why-are-Modern-Neural-Nets-the-way-they-are-And-Hidden-Hypernetworks-6c7195709e7b4abbada921875a951c54
119 views0 comments
Ethan Smith
Jul 28, 20241 min read
Do Diffusion Transformers Deserve The Hype?
https://sweet-hall-e72.notion.site/Do-Diffusion-Transformers-Deserve-The-Hype-9b9ca7bead374b47aac96558714c203b
202 views0 comments
Ethan Smith
May 26, 20241 min read
Automated LoRA Discovery and Teaching Neural Networks to make Neural Networks
https://sweet-hall-e72.notion.site/Automated-LoRA-Discovery-and-Teaching-Neural-Networks-to-make-Neural-Networks-22aa3b5ad66e4bc985ff2c93...
246 views0 comments
Ethan Smith
May 21, 20241 min read
Diffusion and Autoregressive Models for Learning to Solve Mazes
https://sweet-hall-e72.notion.site/Diffusion-and-Autoregressive-Models-for-Learning-to-Solve-Mazes-c3bc4bcdfa304ecd9531ee5445a4da66
339 views0 comments
Ethan Smith
May 6, 20241 min read
Traversing through CLIP Space, PCA and Latent Directions
https://sweet-hall-e72.notion.site/Traversing-through-CLIP-Space-PCA-and-Latent-Directions-b898932e13684d58957405b4a2747a79
1,652 views0 comments
Ethan Smith
Apr 14, 20241 min read
Learning Space Filling Curves with Autoencoders
https://sweet-hall-e72.notion.site/Learning-Space-Filling-Curves-with-Autoencoders-e39e41ce75894c3a8fecfee0f3bbfb23?pvs=4
84 views0 comments
Ethan Smith
Mar 13, 20241 min read
Mimicking Diffusion Models by Sequencing Frequency Coefficients
https://sweet-hall-e72.notion.site/Mimicking-Diffusion-Models-by-Sequencing-Frequency-Coefficients-8e5a60e876d640c390369627d55330b1
1,077 views0 comments
Ethan Smith
Mar 8, 20241 min read
ContrastiveDPO for Diffusion, Generalizing DPO to multiple items
https://sweet-hall-e72.notion.site/ContrastiveDPO-for-Diffusion-Generalizing-DPO-to-multiple-items-PART1-226b3746aa4d4ff9995d1e26b38a9674
162 views0 comments
Ethan Smith
Mar 5, 20241 min read
Dipole Attention: Opposites May Be Deep Connections
Image from: https://twitter.com/toshi2fly/status/911306344376012800 Post: https://sweet-hall-e72.notion.site/Dipole-Attention-Opposites-M...
443 views0 comments
Ethan Smith
Mar 4, 20241 min read
Speeding up Diffusion: Reviewing DiffusionGANs, Consistency Models, and Flow Models
https://sweet-hall-e72.notion.site/Speeding-up-Diffusion-Reviewing-DiffusionGANs-Consistency-Models-and-Flow-Models-80b985120b8f472094cdc...
83 views0 comments
Ethan Smith
Feb 25, 20241 min read
Exploring Cross Attention maps in Diffusion Models
https://sweet-hall-e72.notion.site/Exploring-Cross-Attention-maps-in-Diffusion-Models-98a85f552fbe4e62887b896b756177f4?pvs=4
92 views0 comments
Ethan Smith
Feb 25, 20241 min read
CLIP vs T5 as a text encoder for diffusion models
https://sweet-hall-e72.notion.site/CLIP-vs-T5-as-a-text-encoder-for-diffusion-models-df76bf09cacb425797640da86131267f?pvs=4
157 views0 comments
Ethan Smith
Feb 23, 20241 min read
Response to the broken VAE claim
https://sweet-hall-e72.notion.site/Followup-to-the-broken-VAE-claim-f8e154081cc74b49b81172d4b84af4aa?pvs=4
90 views0 comments
bottom of page