First Tokyo AI RL Talk
I recently gave a talk at the first Reinforcement Learning focused session of Tokyo AI Talks.I gave a 10 minute introduction to RL and then talked about GT S...
Posts by Year
2024
2020
ALA 2020: Temporally Extended Auxiliary Tasks
My paper “Work in Progress: Temporally Extended Auxiliary Tasks” has been accepted to the Adaptive and Learning Agents workshop at AAMAS 2020.This work was d...
2019
Gamma-Nets: Generalizing Value Estimation over Timescale
I’m happy to announce that my paper: “Gamma-Nets: Generalizing Value Estimation over Timescale” has been accepted for oral presentation at AAAI 2020!You can ...
Candidacy Passed!
This is a bit old, but I successfully passed my PhD candidacy exam back in November, 2018. So all I have left to graduate is to finish my research (which is ...
Borealis AI Internship!
Good news (for me at least)! I’ll be starting an internship with Borealis AI, Edmonton in April. I’ll get to work with some great researchers including Matt ...
2018
Generalizing Value Estimation over Timescale
Generalizing Value Estimation over Timescale<p>Sherstan, C., MacGlashan, J., Pilarski, P. M. (2018) Generalizing Value Estimation over Timescale. FAIM ...
Successor Representation Literature
This is a list of literature related to the successor representation. It is not exhaustive and I have not read it all. Right now it is just a list; if I have...
Accelerating Learning in Constructive Predictive Frameworks with the Successor Representation
Accelerating Learning in Constructive Predictive Frameworks with the Successor Representation<p>I’ve got a new paper with Marlos C. Machado and Patri...
Directly Estimating the Variance of the lambda-Return Using Temporal-Difference Methods
Directly Estimating the Variance of the lambda-Return Using Temporal-Difference Methods<p>I’ve got a new paper on arXiv on using TD methods to direct...
2017
Cogitai Internship
This past summer I’ve had the incredible opportunity to do an internship with Cogitai (https://www.cogitai.com/) - An AI startup started by some big names in...
2015
Vanier scholarship provides opportunity of a lifetime - Faculty of Science - University of Alberta
Vanier scholarship provides opportunity of a lifetime - Faculty of Science - University of Alberta<p>A short write up on me receiving the Vanier schola...
Vanier Achieved -> PhD
Well, back in the spring I received the good news that I had been selected as a Vanier scholar. As a result, I am able to do a PhD :) I successfully defended...
Adapting to Automation
I am presently working on an MSc in artificial intelligence at the University of Alberta and thinking a lot about automation these days. I’m writing th...
2014
Erle-copter
Erle-copter<p>A new Linux based, ROS powered quadcopter with an autopilot!</p>
Launch of ROS Edmonton
I’m pleased to announce ROS Edmonton, the Robot Operating System users group for the Edmonton area is starting up! We are set to have our first meetup ...
Synchronization of recorded ROS Topics
One of the assumptions I made when I started using ROS was that rosbags would magically handle data synchronization for me. This was a very wrong assumption....
What I learned in ROS this week
Messages: In a discussion with members of OSRF (https://github.com/ros/std_msgs/issues/7#issuecomment-59396705) I learned that std_msgs shouldn’t reall...