DTIO: Data Stack for AI-driven Workflows
A scalable I/O runtime that unifies disparate I/O stacks for converged HPC, Big Data, and ML workflows.
read more →Hi I'm Neeraj
Tech+comicbook geek, part-time Metal Head, AI & FOSS Enthusiast.
Computer scientist and researcher who uses AI to optimize things, from high-performance computing and distributed systems to storage services and I/O workflows.
Bouldering enthusiast
I also dabble in some social network analysis and stock-market predictions and tinkering with microcontrollers in my spare time. I care deeply about free software, data privacy, and self-hosting.
Welcome to my corner of the internet.
Latest
Viper: A High-Performance I/O Framework for Transparently Updating, Storing, and Transferring Deep Neural Network Models
An I/O framework that determines near-optimal checkpoint schedules and accelerates delivery of the latest model updates for DNN training and inference.
read more →TunIO: An AI-powered Framework for Optimizing HPC I/O
An AI-powered I/O tuning framework that reduces tuning time while achieving the same performance gain through RL-driven early stopping.
read more →