Thinking out loud
Notes & writing.
A space to work through ML systems ideas, unpack papers,
and explore what makes model training efficient.
Every idea starts with a note.
The first entry is still to come. I plan to write about efficient and distributed training, and how choices in model architecture and training objectives interact with the systems that run them.
ML systemsEfficient trainingPaper walkthroughs