Writing
Essays, when a thought is ripe.
Mostly the decisions upstream of training. What to keep, what to throw away, how to know your eval is measuring what you think it's measuring. But nothing here is fenced by topic. Some of it is about perception. Some of it is about being a person.
Multimodal Dataloaders go brrrrrrr
The missing survey on streaming multimodal dataloaders for large scale training
Data Pruning at Scale
AI Insights (2023)
A paper-summary newsletter I ran in college. Kept for the record.
2023-5-15 AI Insights: Multimodal Mixture of Experts & Datasets and No More Tokenization!
Google Research does their magic again! Meta Research with fundamental discovery
2023-5-11 AI Insights: Decoding Videos from Visual Cortex, Six-modality joint embedding space, and more!
2023-5-8 AI Insights: Novel image editing technique, Conditioning pretrained unconditional generative models, and more!
Welcome to Haoli's AI Insights Newsletter!
Summarizing the latest AI literature straight from arXiv
New essays land here first and go out on Substack. Subscribe there if you want them pushed.