Aditya Somasundaram

aditya [dot] somasundaram [at] mbzuai [dot] ac [dot] ae


Profile photo
"Living life one ansatz at a time" - me

I'm a research scientist at the Institute of Foundation Models, working on the pretraining team. My research focuses on optimization of learning algorithms, building better intelligence, and making this affordable and accessible to the world. Someday, I hope to create Jarvis. Prior to this, I was a graduate student at Columbia University advised by Micah Goldblum. During most of my time at Columbia, I was part of Numenta's ML team where I worked on proprietary algorithms to make training LLMs simultaneously faster, and cheaper.

Projects & Publications


Latest News

🎓 I graduated from Columbia University with my Master's in Electrical Engineering, graduating with Honors and a research specialization! Huge thanks to Micah Goldblum for his continued advice and mentorship during my time in his group. I have now joined the pretraining team at the Institute of Foundation Models!

Small Batch

Small Batch Size Training for Language Models: When Vanilla SGD Works, and Why Gradient Accumulation Is Wasteful

Martin Marek, Sanae Lotfi, Aditya Somasundaram, Andrew Gordon Wilson, Micah Goldblum

Advances in Neural Information Processing Systems (NeurIPS), 2025


No Backprop