Feb 2024 – Mar 2024
Feature-based dynamic pricing with contextual bandits
Course project, Reinforcement Learning (Prof. Manu Kumar Gupta)
Implemented the ellipsoid and EXP4 contextual-bandit algorithms of Cohen et al. (2020) and compared their regret, and how they adapt, under changing distributions.
Related: Deep Q-learning agent for pixel-based game control
Aug 2023 – Oct 2023
MultiPDF Insight Engine: retrieval-augmented generation with Gemini
Independent project
A Streamlit app that answers questions over multiple uploaded PDFs, using agentic chunking into propositions with Google Gemini and Hypothetical Document Embeddings (HyDE) to improve retrieval.
Related: Production retrieval-augmented generation at Ola Krutrim
Mar 2023 – Apr 2023
Image colorization with conditional GANs
Course project, Machine Learning (Prof. Balasubramanian Raman)
Trained a conditional GAN for image-to-image translation in the Lab colour space on 8,000+ COCO images.
Related: Generative diffusion models for turbulence and the 2D XY model
Jun 2022 – Jul 2022
Deep Q-learning agent for pixel-based game control
Vision and Language Group, IIT Roorkee
Implemented a deep Q-network (DQN) in PyTorch that learns to act directly from raw game frames through a convolutional network; the trained agent clears the first level of Super Mario Bros.
Related: Contextual bandits for dynamic pricing