Sourav Chakraborty
(Pronounced generally as Saw-ruv and Show-oo-rob in Bengali.)
Official Email   •  
Personal Email
I am a third year Ph.D student in the Computer Science department, at the University of Colorado at Boulder advised by Prof. Lijun Chen.
I am interested in exploring the mathematics of algorithms and strategies for decision-making under uncertainty. Specifically, I work
in the areas of online learning and reinforcement learning.
I graduated with a master's degree in computer science from the same university. Before coming to Boulder, I had worked as a software engineer at Flipkart in India, after graduating from Birla Institute of Technology, Mesra, Ranchi.
When not thinking about work, I treat myself to the world of films, books and music.
Resume  • 
CV  • 
LinkedIn  
|
|
Updates
- 2024-03: Continuing as a CS Lead TA for the AY 2024-25.
- 2024-01: My paper got accepted at IEEE ACC 2024!
- 2023-08: Guest lectured for Fall'23-Advanced ML on Bandit Models!
- 2023-03: Elected as a student rep. for the GradComm.
- 2023-03: Re-appointed as a CS Lead TA for the AY 2023-24.
- 2022-08: Started my Ph.D journey at CU!
- 2022-05: Graduated with Master of Science in CS @ Colorado
- 2022-04: Successfully defended Master's thesis! (link/
slides)
- 2022-02: Got offer for Ph.D from CS @ Colorado for Fall 2022!
- 2019-08: Started M.S in Computer Science at Colorado!
- 2016-12: Joined Flipkart as a Software Engineer, in Bangalore, India.
- 2016-06: Bachelor's degree in engineering completed from BIT Mesra.
|
Awards & Honors
- 2024-04: Won the Outstanding Research Paper Award from the CS department.
- 2024-04: Won the Full Conference Travel Fellowship for ACC in Toronto, Canada 2024.
- 2024-04: Won the CU research Expo research poster annual award for the annual year 2023-24.
- 2024-03: Won the Publication Recognition Award for the annual year 2023-24.
- 2022-09: Won the Early Career Development Fellowship from the CS department.
- 2022-05: Won the Lloyd Botway Award for Outstanding Master's student for "outstanding academics, teaching, research and service to the department"!
- 2022-04: Won the CU research Expo research poster annual award for the annual year 2021-22.
- 2022-04: Selected as a Lead Teaching Assistant (department lead) for CS @ CU for the annual year.
|
|
Incentivized Exploration in Non-stationary Stochastic Bandits.
Sourav Chakraborty and Lijun Chen
Accepted at IEEE American Control Conference (ACC) 2024 in Toronto, Canada.
conference version /
arXiv
We explore incentivized exploration in the multiarmed bandit (MAB) problem with changing reward distributions and biased feedback. Our algorithms address abruptly and continuously changing environments, achieving sublinear regret and compensation, effectively incentivizing exploration despite challenges.
|
|
Incentivized Exploration in Non-stationary Stochastic Bandits.
Sourav Chakraborty
Master's Thesis, defended on April 2022.
Committee: Lijun Chen,
Raf Frongillo, Bo Waggoner.
thesis /
slides
We explore incentivized exploration in the multiarmed bandit (MAB) problem with changing reward distributions and biased feedback. Our algorithms address abruptly and continuously changing environments, achieving sublinear regret and compensation, effectively incentivizing exploration despite challenges.
|
 |
- Fall 2024: Teaching Assistant for CSCI 3104 - Algorithms
- Summer 2024: Teaching Assistant for CSCI 2270 - Data Structures.
- Spring 2024: Teaching Assistant for CSCI 3104 - Algorithms
- Fall 2023: Teaching Assistant for CSCI 2275 - Programming and Data Structures.
- Spring 2023: Teaching Assistant for CSCI 2270 - Data Structures.
- Fall 2022: Teaching Assistant for CSCI 2270 - Data Structures.
- Spring 2022: Teaching Assistant for CSCI 2270 - Data Structures.
- Fall 2021: Instructor for CSCI 1200 - Introduction to Computational Thinking.
- Summer 2021: Teaching Assistant for CSCI 1300 - Starting Computing.
- Spring 2021: Teaching Assistant for CSCI 1300 - Starting Computing.
- Fall 2020: Teaching Assistant for CSCI 1300 - Starting Computing.
- Summer 2020: Instructor for CSCI 3022 - Introduction to Data Science with Probability & Statistics.
|
Selected Personal Projects
*Alphabetically
|
|
Inverse Reinforcement Learning via Maximum Entropy Formulation.
Tuhina Tripathi, Alexa Reed, Sourav Chakraborty
April , 2022
report  / 
code / 
demo / 
interface-code
Final project for ASEN 5519: Decision Making Under Uncertainty. This project explores the use of Inverse Reinforcement Learning, via Maximum Entropy Formulation, in a Markov Decision Process. The concepts explored in this project were demonstrated using a grid world environment.
|
|
Incentivized Exploration for Multi-Armed Bandits under Reward Drift.
Sourav Chakraborty
September, 2020
original paper  / 
code
Just playing around with the paper by Liu & Wang et alon Incentivized Exploration for Multi-Armed Bandits under Reward Drift
where the players receive compensation for exploring arms other than the greedy choice and may provide biased feedback on reward drift.
|
|
Contextual vectorized representation of words: Soam word embeddings
*Amit Baran Roy, Sourav Chakraborty
May, 2020
report  / 
code
A word embedding model implementation based on the popular skipgram architecture. It involves alterations of the scoring algorithm to give more weightage to the context words that are closer to the target word in a skipgram sliding window.
|
|
Solving Games using the combination of Q-learning and Regret Matching Methods
Sourav Chakraborty, Nagarajan Shanmuganathan
May, 2020
report  / 
code
It is known well that Counterfactual regret minimization
(CFR) has been used in games which have both terminal states and perfect recall to minimize regret. This project aims to relax those constraints
and use a local no-regret algorithm (LONR) by Kash et al, which internally uses a Q-learning like update rule to games which do not have terminal states or
perfect recall.
|
|
Occupancy Network based 3D Image Reconstruction using Single-Depth View
*Amit Baran Roy, Aparajita Singh, Sourav Chakraborty, Tanmai Gajula
Feb-April, 2020
report  / 
code
The complete 3D geometry of an object from a single 2.5D depth view was acquired by using deep learning techniques such as generative adversarial networks and 3D convolution neural networks. The resolution of the final 3D voxelized output was improved by transforming the voxel representation into another representation called occupancy networks.
|
Last updated: Sep 2024 Thanks Jon Barron!
|