Shrey Modi
Engineer & ML researcher · building evsys-sdk
Hi, I'm Shrey. I work on post-training and continual learning for language models, and I'm building evsys-sdk, an open-source SDK for exactly that (docs). I studied Computer Science at IIT Bombay and completed an MS in Computer Science at the University of Chicago.
I have a background in ML research with papers at ICLR and NeurIPS, and I like building things at the early, messy stage of a company. Outside of work it's long runs, lifting, and a lot of rock and rap.
Writing
How I think about continual learning: a two-agent system
Why continual learning is better seen as a closed-loop system with autoresearch inside it, rather than a single learning algorithm.
Research
Bayesian Coreset Optimization for Personalized Federated Learning
Optimizing federated learning through Bayesian coresets.
Accelerating Malware Classification: A Vision Transformer Solution
Speeding up malware classification with a Vision Transformer model.
Selective Uncertainty Propagation in Offline RL
A selective uncertainty propagation mechanism to improve efficiency in offline reinforcement learning.
More on Google Scholar.
Experience
Nexus Venture Partners
Built automation tools for startup sourcing and ran AI market research.
Barclays
Built a CSV editor to automate reliability-testing workflows.
babblebots.ai
Worked on voice authentication systems and backend, deployed on Google Cloud.
Mizuho Bank
Built an OCR-based discrepancy checker for trade-document validation.
Projects
Detecting Attacks from System Audit Logs
Graph Neural Networks over system audit logs to flag potential security threats.
Video Summarization with Locality-Sensitive Hashing
Efficient video summarization by clustering frames with LSH.
Generative Pre-training from Pixels
A sequence transformer with a BERT encoder and GPT-2-style decoder for autoregressive pixel prediction.
Multilingual Speech Recognizer
State-tied triphone HMMs for Wolof and Marathi using Kaldi and SoX.
P2P File Sharing System
A peer-to-peer file-sharing network over TCP sockets, using BFS for search.