{"id":569,"date":"2021-03-23T02:02:40","date_gmt":"2021-03-23T02:02:40","guid":{"rendered":"http:\/\/kb.shoelace.biz\/?p=569"},"modified":"2025-11-08T15:37:12","modified_gmt":"2025-11-08T15:37:12","slug":"reinforcement-learning-for-speed","status":"publish","type":"post","link":"https:\/\/kb.shoelace.biz\/?p=569","title":{"rendered":"Reinforcement Learning for Speed"},"content":{"rendered":"\n<p>I have recently written a paper on applying <a href=\"https:\/\/en.wikipedia.org\/wiki\/Q-learning\">Q-Learning<\/a> &#8211; a reinforcement learning algorithm &#8211; to the acceleration problem brought up in my <em>Going Fast on Your Own Power<\/em> series. The paper&#8217;s abstract, the paper itself, and a corresponding presentation are below.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Abstract<\/h2>\n\n\n\n<p>In this report, Q-Learning is used to maximize velocity and minimize driver fatigue in a human powered vehicle attempting a land speed record. Q-Learning results in a set of Q-values for state-action pairs, called a policy. That policy is utilized here to provide a function of power input over time for a given driver, vehicle, and environment combination that maximizes velocity for the driver\u2019s fatigue limit.This function of power input over time results in higher achievable speeds than other methods of developing a power over time function.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Paper<\/h2>\n\n\n\n<div class=\"wp-block-file\"><a href=\"http:\/\/kb.shoelace.biz\/wp-content\/uploads\/2021\/03\/Q-Learning-for-Speed.pdf\">Q-Learning-for-Speed<\/a><a href=\"http:\/\/kb.shoelace.biz\/wp-content\/uploads\/2021\/03\/Q-Learning-for-Speed.pdf\" class=\"wp-block-file__button\" download>Download<\/a><\/div>\n\n\n\n<h2 class=\"wp-block-heading\">Presentation<\/h2>\n\n\n\n<figure class=\"wp-block-embed-youtube wp-block-embed is-type-video is-provider-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"CSE573 Project - Reinforcement Learning (Q-Learning) for Speed\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/CLwedjVy14w?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>I have recently written a paper on applying Q-Learning &#8211; a reinforcement learning algorithm &#8211; to the acceleration problem brought up in my Going Fast on Your Own Power series. The paper&#8217;s abstract, the paper itself, and a corresponding presentation are below. Abstract In this report, Q-Learning is used to maximize velocity and minimize driver&#8230;<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[12,6],"tags":[],"class_list":["post-569","post","type-post","status-publish","format-standard","hentry","category-bicycling","category-optimization"],"_links":{"self":[{"href":"https:\/\/kb.shoelace.biz\/index.php?rest_route=\/wp\/v2\/posts\/569","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/kb.shoelace.biz\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/kb.shoelace.biz\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/kb.shoelace.biz\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/kb.shoelace.biz\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=569"}],"version-history":[{"count":1,"href":"https:\/\/kb.shoelace.biz\/index.php?rest_route=\/wp\/v2\/posts\/569\/revisions"}],"predecessor-version":[{"id":989,"href":"https:\/\/kb.shoelace.biz\/index.php?rest_route=\/wp\/v2\/posts\/569\/revisions\/989"}],"wp:attachment":[{"href":"https:\/\/kb.shoelace.biz\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=569"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/kb.shoelace.biz\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=569"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/kb.shoelace.biz\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=569"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}