Kshitij Gupta

I am a graduate Student at Mila. I am advised by Prof. Sarath Chandar and Prof. Irina Rish.

I am passionate about building general intelligence. I am specifically interested in Interactive Intelligence, Sequential Decision Making, Reasoning, Planning, Memory and Allignment of Foundation models for Sequential tasks.

Email  /  GitHub  /  LinkedIn  /  Twitter  

• Sep 2021Started Graduate Studies at Mila!
• June 2021Summer 2021 at Microsoft, Redmond.
• July 2020 IlliniMet accepted to The Second Workshop on Figurative Language Processing, ACL 2020
• July 2020 Undergraduate Researcher at Koyejo Labs, CS@Illinois with Prof Sanmi Koyejo
• June 2020Summer 2020 at Microsoft, Redmond.
• May 2020 Awarded the Senior 100 Honorary.
• May 2020 Awarded the Illinois Engineering Achievement Scholarship.
• April 2020Named Henry Ford || Scholar.
• April 2020Awarded the Kay Simmons-Kappes Outstanding Contribution Scholarship.
• April 2020Named to the Dean's list consecutively for all semesters.
• Jan 2020  Undergraduate Researcher at Coordinated Science Laboratory with Prof Suma Bhat
• Sept 2019Awarded the Illinois Engineering Achievement Scholarship.
• Oct 2019  C3SR-Undergraduate Research in AI Scholar, IBM-ILLINOIS with Prof Suma Bhat
• Oct 2019  Undergraduate Researcher at CS@Illinois with Prof Jian Peng
• June 2019Summer 2019 at Microsoft, Redmond.
...
• May 2018 Summer 2018 at CSS Corp, Milpitas.
• Sept 2017Research Mentee at UIUC Pure.
• Aug 2017 Recevied the James Scholars Honors.
• June 2017Summer 2017 at eRx Solutions, Bangalore.
• Oct 2016  Paper on Reusable Instant Cooler based on Endothermic Chemical Reactions accepted to IJIRSET.

In this work, we study and demonstrate the importance of various design decisions for Recurrent PPO in partially observable domains with long episodes and in continuing tasks. We also show that simple strategies like updating hidden states (before collecting new experience) and recomputing hidden states (before each epoch in minibatch gradient descent) can prevent staleness in updates and significantly improve performance. Finally, we provide practical insights and recommendations for implementing Recurrent PPO.

We present IlliniMet, a system to automatically detect metaphorical words. Our model combines the strengths of the contextualized representation by the widely used RoBERTa model and the rich linguistic information from external resources such as WordNet.

Model-based RL has a strong advantage of being sample efficient. Once the model and the cost function are known, we can plan the optimal controls without further sampling. We explore various model based planning methods and experiment on various Gym Environments.

This paper explores the use of reversible endothermic gaseous chemical reactions to create a truly portable, reusable instant cooler that is human powered.

• May 2020 Awarded the Senior 100 Honorary.
• May 2020 Awarded the Illinois Engineering Achievement Scholarship.
• April 2020Named Henry Ford || Scholar.
• April 2020Awarded the Kay Simmons-Kappes Outstanding Contribution Scholarship.
• April 2020Named to the Dean's list consecutively for all semesters.
• Sept 2019Awarded the Illinois Engineering Achievement Scholarship.
• Oct 2019  C3SR-Undergraduate Research in AI Scholar, IBM-ILLINOIS with Prof Suma Bhat
• Aug 2017 Recevied the James Scholars Honors.

Template Credits Jon Barron Unnat Jain