AI and Machine Learning are the hot topics this decade, not only in industry, but also in computer science education, as they contain many exciting and interesting new concepts. However, many educators think these topics are “magical”, too complex, and that they can’t be taught in classrooms.
But Machine Learning does not have to be crazy magic! Using the Snap!-environment, which is perfect for creating games with, we can use Machine Learning to teach an AI how to beat us at our favorite games.
We use Reinforcement Learning implemented entirely in Snap! itself, without relying on external libraries, JavaScript-wrappers, or servers. Because of this, the learning algorithm is fast, intuitive, simple, and can easily be visualized for easier understanding. It also means that our approach can be transferred to many other game settings, simulations, problems, etc.
Explore the magic with us!
data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAKAAAAB4CAYAAAB1ovlvAAANG0lEQVR4Xu2de3BU5RmHf2cvuWw2G3K/mQgWhSRSikCRoAiDsRc7KkNq6xWcccbWDuCEgESmhZY/QILoRHE6046VSHHaEa0i1iloGIREJSAkaIKEBAgBcgNy2+z1nM45y17ZLOfEczYnu+/3D7m85/3e73mf/c5lE8JsreU40JBMYMUsu6Rjqur1kuKjJZiRKqAv+GiEKlW8QJGikVmoF9MNAgYD7IYW6nvR8oolAeXttJ+AoeDyEo70/Wh6VZOACghIUMVDJVYjs+LvJhhGPEs+UtgBR4LqcDiwZ88eFBUVwWAwSMssIpqv1ZBgQG9Xp4hoaSHmoUGkZGTjwuVufH3eDuTPk5ZghGgSUBaMniQhBdy7dy8KCgrkndEnW25WBjoq7kS2UaPAHAwca4+ju7sbHMdhTzMLTWbhD54n1GXIzS5hfvDkEZggpIDNzc2yLnnTpk2oqKjw5Ow43YCFmibELPwDnOePQZNdBHPlfMQueRna3B+DSUyDbf9r0BaWwF7zBvQLl4Nt+xK64mVwHH4bunnL4GzaD93MX4Mb7IGztQ7arAJYdq8B23ESjooGtLe3C/Md+KoRtqLHZVnPzW7Gov1JgRTIIQVsaGgQcvE7CL8bPvroo8jKyoLFYoHRaMSpU6eQl5eHdevWCTF2ux2lpaV49dVXsXHjRsTFxYHPMXnyZJSVlQkx/Klcr9ejsrISXWebsXCwBvqSF6BJzgOsZgxtmoPY0i2wvl+B+OUfw3F0NzSZd8DZWovYhzZi6M/TEP/8B2DiTOAGu2H9cD3gtCPu2X+CPfs1OLsFYB2wfrAOthePo62tTVjDt+evojvrfilsQsaSZPKgDHkXXF9f7xFwx44dglirVq3C5s2bUV5ejm3btmHNmjVYuXIlqqqqkJubi5ycHDQ2NmLx4sXQ6XRIS0vDzp07hY8HBgYwadIk5OfnIyUlBdcutuK+c29BX7wMzu8PCqIxiemCiNZPNyP2oQ2w170D/b3PwnnqALRTFsB++B/QFy+FvXYHdLN/A/ZSExxH30NMSRmc7cehKywR5OXHcPlRtLS0CB9/eqAOpgVl8lCjLLIRCPog2v3q3r59O2bMmCHsXIzP7Y1cnyfogKkfPSXbYvwSMQzal36Krq4u2Gw2HNfPhSbWqMxclHXUBEIKyGetrq6G0+kUJByPo9ceD80dv4Q+MW08lq9oze6NZiyf44Z8K04NBSragShOfrMbqXChkfxecLgKo3mUJUACKsuXsvsQkPrwPJynZNoBo0BVqQK6kYRDRBIwggUcrXgkYARLIXVpsVrA6pR6lCueBBwdNzpKJgIkoEwgR5smsAHhuKYZba1KHBduAUf941hKLH6scyrxmOGHnA7Hgsd4+MmdiLoJEfOKp10QUNOvWESEgGLE892BollCta19XAsoVbzA06DamiHXaZp/117iT8bLNbXkPCSgZGR0gJwESEA5aaoo12juSMeifBJwLKjTnB4CJCDJMKYEIlLAUL9Ez9OO1JuPMTVplJOPawFHer/TVzD65aFRmhGmw8a9gIES0u4WJnNkmiYiBJSJBaUZAwIk4BhAV8OUanlMQwKqwQYV1OArZDjfSSEBVdD8aC6BBIzm7qtg7SSgCpoQzSWQgNHcfRWsnQRUQROiuQQSMJq7r4K1k4AqaEI0l0ACRnP3VbB2ElAFTYjmEkjAaO6+CtZOAqqgCdFcAgkYzd1XwdpJQBU0IdJLaG86gryC2UGXSQJGevfHen32IXz3ghETN/XCYEq5oRoScKwbFOHzP5F6F3aWnwFT0Uc7YIT3WpXLKy0sw61J9Xil7iAJqMoORXhRk1O+wMNT1pGAEd5n1S5v1dz5Qm3bj3wMi8NE14Cq7VSEFuYW8M36PRi2J5GAEdpnVS4r2/gdHp/2O6E2ugZUZYsiuyj37kcCRnafVbc6LePAotu2YVrGx0JtJzofwf7W4H+plJ4Dqq59478g351v2GHCm0dcIgYbJOD477e6VnC5GqsW/12o6dJgIXY1/jVkfSSguto37qs5d7IOLUdrsGjpS6LWQgKKwkRBShEgAZUiS3lFESABRWGiIKUIkIBKkaW8ogiQgKIwUZBSBEhApchSXlEESEBRmChIKQIkoFJkKa8oAiSgKEwUpBQBElApspRXFAESUBQmClKKAAmoFFnKK4oACSgKEwUpRYAEVIos5RVFgAQUhYmClCJAAipFlvKKIkACisJEQUoRIAGVIkt5RRFQrYDlxYzfAioPs2AY/6+JWiEFqZqA6gR0i7elxMVt9YYVqNxQhdXrV4C5pwpba/k/pUcjUgioTkB2vXeX4+ULHFvxGu2EkWIfANUKyO94YADNPVVgD63w/EsCRpB9oQTkqh8A89iHAMcCMQlhW7V7B3SfcrnD/rsgL2TlYToNh60hCk/ktwNynQ3g3l6EJLYHFjtgjAF6hwHNqnbAdIsipbiv+Xyv7fiv8Sdi1kc+Zl4V3DLyH9O1oCLtCHtSr4D97WDfWgCTuRUT4rx18HtN+4AWmt+fADKKZC/QveOt2Qc/qcrYlcJp1z14+Xjx+EHyyd6GMUvoEZCtLkF+z36hEJYDLA7AoAd6zUCqAThvMUHzUvD/53e01fM7HX+3++I+4OUSwC3h6nkabL6fw1pXOX6DTr+jpa3O4zwCcrWvIKe2HJ1DQE4i0N4P5JmAjgEgNxG4PAg4KoYAvUG2lbgF5BPy8rmH+xEM/7lbTv7fSnoEIxt7tSTy7oCVWcjTdgqiZRmBPguQGAs4WEAD4LJZC+ZPDm/dMj0TXh3wwJnfCT2nXR9Ka/cBm0uAtfsZ8A+laUQGAe8O+N1uZH9SCi0DmO1AQgzQYwbSrm94PXYDLKv7AI1O0ZX7vgPC74Tl/APo67K7b0ToJkTRFoQ1uf9d8AYG6QZAr4UgIn8tyPf+wgDALNkFTHtMXHEMwF0/VtwBrihePt/HLrxo/Ntv7KHl0N77OhwHl0M3/3W8/IWTHkZLAavi2IAH0Ry4v8QhM94m7H7JccCVYYAtLgfzQKXiywh8/5efkBeQ422+Pug9YcXbENYJmPWfPXzDU11NZx8YsxVcYjzYtMSwFkSTRReBoAJGFwJa7VgSYF74YxGXtGCyp4au6iOIvTUZSfd5v9b9r28Qmz8BprmTYLvcj6ufNCHjqdlg9Pz9MWC72I+r+5pdX9O47hgsrb3oO9CCjCdngYnRIljeK3u/RcqD3ofb1z4/DXvXANJ/e5ennmv7v4ejbxhpS6aDtTjQvesokn9RgJhs7x894efxXYOn3rsn4ur/TiH5Z1PR9U49DAWZMM7KC15vWy/6arz1Cms404P+w23IeNr1lx59ObgL7HnvBNJKp3vrrTkNxxWzUK97XP1vE1ibA6kPTxO+1PnWV0h5sBD6TNfZxTlow1Bjh8DXPcTWq0s1hMzb8+9vkPLQndCnJSAo35oWWNt6YZx5CxKm58ISjENrD/oPBXDImwBTsbfeQImv1bTAcWXoRg5WB1If8XJgls7UcOlPzoKhMBNXPjopAGd0GgF6/NQM9H7QiIEvz4HRMshY9lN0v3sM7JAN+nQjclbOB2uxo6OyBqzVgZjcJGQ/Pw/OaxZ0VB0EZ3UIMsfeMiFo3sGvzsF4960CQHNzJ7qr68GxHJLm34bkXxXBfPISunceFa4BJyy6HcNNnbBe6IMmVoecsgXQJsTgwpbPwZpt3nr/04iBOle9TIwOnNUOJlYvxPAvmKzn5qHzb3Uh6816rhjssB0XtnwGzupE3MQU6HNMnrwZz8xB/I9SBRZDDZdGrHfC/VMwWH8ePe83AByQ/PMC9B9qhbPfAq0xBrnlC8FotbhYdRCOq2b45T1xUVS90DAh89q7B6Ex6JG6ZDp6dh0LztfJgtFrkfHETHS9e8zTt2AcYnKS0F931uXDM3NgmJpxwwY61HDRr28uDu3oef/EdQ5TBaF5DszTP+HRAIlzJ2Kg7qwnGT9BYvFt6P/izIg7dNzkNNg6+oRmuUf8lAzYOq4Jr+pgI1he0z2T0F971nXbfX0kLbwdfTWnR5xba4qDLsUA69krQoyYeoMlC1avoSgL5qZOv3r8jmUYJM7JF16YoeoNZBo4vzYpDrpk7xr4502BeQOPuRlfPv6GvEEWfjO+/CFiOKQ/NgPGmXmeGfpr29C7u8FvxlAcPAKO2Gn6BhEIRYBhkLl0NgzTstF38IxwFnVtaeIGCSiOE0XdhED6kzOF067UQQJKJUbxshIgAWXFScmkEiABpRKjeFkJkICy4qRkUgmQgFKJUbysBEhAWXFSMqkESECpxCheVgIkoKw4KZlUAiSgVGIULysBElBWnJRMKgESUCoxipeVAAkoK05KJpUACSiVGMXLSoAElBUnJZNKgASUSoziZSVAAsqKk5JJJUACSiVG8bISIAFlxUnJpBIgAaUSo3hZCZCAsuKkZFIJkIBSiVG8rARIQFlxUjKpBEhAqcQoXlYC/wffNCzAv3rxIwAAAABJRU5ErkJggg==data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAeAAAAFoCAYAAACPNyggAAAOhUlEQVR4Xu3VwQkAAAjEMN1/abewn7jAQRC64wgQIECAAIF3gX1fNEiAAAECBAiMAHsCAgQIECAQCAhwgG6SAAECBAgIsB8gQIAAAQKBgAAH6CYJECBAgIAA+wECBAgQIBAICHCAbpIAAQIECAiwHyBAgAABAoGAAAfoJgkQIECAgAD7AQIECBAgEAgIcIBukgABAgQICLAfIECAAAECgYAAB+gmCRAgQICAAPsBAgQIECAQCAhwgG6SAAECBAgIsB8gQIAAAQKBgAAH6CYJECBAgIAA+wECBAgQIBAICHCAbpIAAQIECAiwHyBAgAABAoGAAAfoJgkQIECAgAD7AQIECBAgEAgIcIBukgABAgQICLAfIECAAAECgYAAB+gmCRAgQICAAPsBAgQIECAQCAhwgG6SAAECBAgIsB8gQIAAAQKBgAAH6CYJECBAgIAA+wECBAgQIBAICHCAbpIAAQIECAiwHyBAgAABAoGAAAfoJgkQIECAgAD7AQIECBAgEAgIcIBukgABAgQICLAfIECAAAECgYAAB+gmCRAgQICAAPsBAgQIECAQCAhwgG6SAAECBAgIsB8gQIAAAQKBgAAH6CYJECBAgIAA+wECBAgQIBAICHCAbpIAAQIECAiwHyBAgAABAoGAAAfoJgkQIECAgAD7AQIECBAgEAgIcIBukgABAgQICLAfIECAAAECgYAAB+gmCRAgQICAAPsBAgQIECAQCAhwgG6SAAECBAgIsB8gQIAAAQKBgAAH6CYJECBAgIAA+wECBAgQIBAICHCAbpIAAQIECAiwHyBAgAABAoGAAAfoJgkQIECAgAD7AQIECBAgEAgIcIBukgABAgQICLAfIECAAAECgYAAB+gmCRAgQICAAPsBAgQIECAQCAhwgG6SAAECBAgIsB8gQIAAAQKBgAAH6CYJECBAgIAA+wECBAgQIBAICHCAbpIAAQIECAiwHyBAgAABAoGAAAfoJgkQIECAgAD7AQIECBAgEAgIcIBukgABAgQICLAfIECAAAECgYAAB+gmCRAgQICAAPsBAgQIECAQCAhwgG6SAAECBAgIsB8gQIAAAQKBgAAH6CYJECBAgIAA+wECBAgQIBAICHCAbpIAAQIECAiwHyBAgAABAoGAAAfoJgkQIECAgAD7AQIECBAgEAgIcIBukgABAgQICLAfIECAAAECgYAAB+gmCRAgQICAAPsBAgQIECAQCAhwgG6SAAECBAgIsB8gQIAAAQKBgAAH6CYJECBAgIAA+wECBAgQIBAICHCAbpIAAQIECAiwHyBAgAABAoGAAAfoJgkQIECAgAD7AQIECBAgEAgIcIBukgABAgQICLAfIECAAAECgYAAB+gmCRAgQICAAPsBAgQIECAQCAhwgG6SAAECBAgIsB8gQIAAAQKBgAAH6CYJECBAgIAA+wECBAgQIBAICHCAbpIAAQIECAiwHyBAgAABAoGAAAfoJgkQIECAgAD7AQIECBAgEAgIcIBukgABAgQICLAfIECAAAECgYAAB+gmCRAgQICAAPsBAgQIECAQCAhwgG6SAAECBAgIsB8gQIAAAQKBgAAH6CYJECBAgIAA+wECBAgQIBAICHCAbpIAAQIECAiwHyBAgAABAoGAAAfoJgkQIECAgAD7AQIECBAgEAgIcIBukgABAgQICLAfIECAAAECgYAAB+gmCRAgQICAAPsBAgQIECAQCAhwgG6SAAECBAgIsB8gQIAAAQKBgAAH6CYJECBAgIAA+wECBAgQIBAICHCAbpIAAQIECAiwHyBAgAABAoGAAAfoJgkQIECAgAD7AQIECBAgEAgIcIBukgABAgQICLAfIECAAAECgYAAB+gmCRAgQICAAPsBAgQIECAQCAhwgG6SAAECBAgIsB8gQIAAAQKBgAAH6CYJECBAgIAA+wECBAgQIBAICHCAbpIAAQIECAiwHyBAgAABAoGAAAfoJgkQIECAgAD7AQIECBAgEAgIcIBukgABAgQICLAfIECAAAECgYAAB+gmCRAgQICAAPsBAgQIECAQCAhwgG6SAAECBAgIsB8gQIAAAQKBgAAH6CYJECBAgIAA+wECBAgQIBAICHCAbpIAAQIECAiwHyBAgAABAoGAAAfoJgkQIECAgAD7AQIECBAgEAgIcIBukgABAgQICLAfIECAAAECgYAAB+gmCRAgQICAAPsBAgQIECAQCAhwgG6SAAECBAgIsB8gQIAAAQKBgAAH6CYJECBAgIAA+wECBAgQIBAICHCAbpIAAQIECAiwHyBAgAABAoGAAAfoJgkQIECAgAD7AQIECBAgEAgIcIBukgABAgQICLAfIECAAAECgYAAB+gmCRAgQICAAPsBAgQIECAQCAhwgG6SAAECBAgIsB8gQIAAAQKBgAAH6CYJECBAgIAA+wECBAgQIBAICHCAbpIAAQIECAiwHyBAgAABAoGAAAfoJgkQIECAgAD7AQIECBAgEAgIcIBukgABAgQICLAfIECAAAECgYAAB+gmCRAgQICAAPsBAgQIECAQCAhwgG6SAAECBAgIsB8gQIAAAQKBgAAH6CYJECBAgIAA+wECBAgQIBAICHCAbpIAAQIECAiwHyBAgAABAoGAAAfoJgkQIECAgAD7AQIECBAgEAgIcIBukgABAgQICLAfIECAAAECgYAAB+gmCRAgQICAAPsBAgQIECAQCAhwgG6SAAECBAgIsB8gQIAAAQKBgAAH6CYJECBAgIAA+wECBAgQIBAICHCAbpIAAQIECAiwHyBAgAABAoGAAAfoJgkQIECAgAD7AQIECBAgEAgIcIBukgABAgQICLAfIECAAAECgYAAB+gmCRAgQICAAPsBAgQIECAQCAhwgG6SAAECBAgIsB8gQIAAAQKBgAAH6CYJECBAgIAA+wECBAgQIBAICHCAbpIAAQIECAiwHyBAgAABAoGAAAfoJgkQIECAgAD7AQIECBAgEAgIcIBukgABAgQICLAfIECAAAECgYAAB+gmCRAgQICAAPsBAgQIECAQCAhwgG6SAAECBAgIsB8gQIAAAQKBgAAH6CYJECBAgIAA+wECBAgQIBAICHCAbpIAAQIECAiwHyBAgAABAoGAAAfoJgkQIECAgAD7AQIECBAgEAgIcIBukgABAgQICLAfIECAAAECgYAAB+gmCRAgQICAAPsBAgQIECAQCAhwgG6SAAECBAgIsB8gQIAAAQKBgAAH6CYJECBAgIAA+wECBAgQIBAICHCAbpIAAQIECAiwHyBAgAABAoGAAAfoJgkQIECAgAD7AQIECBAgEAgIcIBukgABAgQICLAfIECAAAECgYAAB+gmCRAgQICAAPsBAgQIECAQCAhwgG6SAAECBAgIsB8gQIAAAQKBgAAH6CYJECBAgIAA+wECBAgQIBAICHCAbpIAAQIECAiwHyBAgAABAoGAAAfoJgkQIECAgAD7AQIECBAgEAgIcIBukgABAgQICLAfIECAAAECgYAAB+gmCRAgQICAAPsBAgQIECAQCAhwgG6SAAECBAgIsB8gQIAAAQKBgAAH6CYJECBAgIAA+wECBAgQIBAICHCAbpIAAQIECAiwHyBAgAABAoGAAAfoJgkQIECAgAD7AQIECBAgEAgIcIBukgABAgQICLAfIECAAAECgYAAB+gmCRAgQICAAPsBAgQIECAQCAhwgG6SAAECBAgIsB8gQIAAAQKBgAAH6CYJECBAgIAA+wECBAgQIBAICHCAbpIAAQIECAiwHyBAgAABAoGAAAfoJgkQIECAgAD7AQIECBAgEAgIcIBukgABAgQICLAfIECAAAECgYAAB+gmCRAgQICAAPsBAgQIECAQCAhwgG6SAAECBAgIsB8gQIAAAQKBgAAH6CYJECBAgIAA+wECBAgQIBAICHCAbpIAAQIECAiwHyBAgAABAoGAAAfoJgkQIECAgAD7AQIECBAgEAgIcIBukgABAgQICLAfIECAAAECgYAAB+gmCRAgQICAAPsBAgQIECAQCAhwgG6SAAECBAgIsB8gQIAAAQKBgAAH6CYJECBAgIAA+wECBAgQIBAICHCAbpIAAQIECAiwHyBAgAABAoGAAAfoJgkQIECAgAD7AQIECBAgEAgIcIBukgABAgQICLAfIECAAAECgYAAB+gmCRAgQICAAPsBAgQIECAQCAhwgG6SAAECBAgIsB8gQIAAAQKBgAAH6CYJECBAgIAA+wECBAgQIBAICHCAbpIAAQIECAiwHyBAgAABAoGAAAfoJgkQIECAgAD7AQIECBAgEAgIcIBukgABAgQICLAfIECAAAECgYAAB+gmCRAgQICAAPsBAgQIECAQCAhwgG6SAAECBAgIsB8gQIAAAQKBgAAH6CYJECBAgIAA+wECBAgQIBAICHCAbpIAAQIECAiwHyBAgAABAoGAAAfoJgkQIECAgAD7AQIECBAgEAgIcIBukgABAgQICLAfIECAAAECgYAAB+gmCRAgQICAAPsBAgQIECAQCAhwgG6SAAECBAgIsB8gQIAAAQKBgAAH6CYJECBAgIAA+wECBAgQIBAICHCAbpIAAQIECAiwHyBAgAABAoGAAAfoJgkQIECAgAD7AQIECBAgEAgIcIBukgABAgQICLAfIECAAAECgYAAB+gmCRAgQICAAPsBAgQIECAQCAhwgG6SAAECBAgIsB8gQIAAAQKBgAAH6CYJECBAgIAA+wECBAgQIBAICHCAbpIAAQIECAiwHyBAgAABAoGAAAfoJgkQIECAgAD7AQIECBAgEAgIcIBukgABAgQICLAfIECAAAECgYAAB+gmCRAgQICAAPsBAgQIECAQCAhwgG6SAAECBAgIsB8gQIAAAQKBgAAH6CYJECBAgIAA+wECBAgQIBAICHCAbpIAAQIECAiwHyBAgAABAoGAAAfoJgkQIECAgAD7AQIECBAgEAgIcIBukgABAgQIHLFxAWmhEwHPAAAAAElFTkSuQmCCen:calculate success rate
en:appear
en:disappear
en:initialize variables
526number of barrels10.010.90best actionrewardstatede:springe
floormonkey1de:tu Nichts
de:ist _ leer?
ca:_ buida?
es:_ vacía?
fr:_ vide?
de:wenn _ dann _ sonst _
ca:si _ llavors _ si no _
es:si _ entonces _ sino _
fr:si _ alors _ sinon _
de:für _ = _ bis _ _
ca:per _ = _ fins _ _
es:para _ = _ hasta _ _
fr:pour _ allant de _ à _ _
110ide:für jedes _ von _ _
ca:per cada _ de _ _
es:para cada _ de _ _
fr:pour chaque _ de _ _
de:erzeuge Modell mit Lernrate: _ Discountfaktor: _ Zufallsfaktor: _ Liste verfügbarer Aktionen: _
0.750.90.05de:bestes Verhalten für Zustand: _ Modell: _
maxValuechosenActionactionsZeromaxValue2chosenAction2actionsZeroi201de:hole Q-Wert für Zustand: _ Modell: _
qitem1-1de:Aktualisiere Modell: _ alter Zustand: _ neuer Zustand: _ Belohnung: _ gezeigtes Verhalten: _
22,0.75,1.999834563877489321,1.6874999996733493,09,1.3749999999779448,0-3,0,0.75-4,-0.84375,1.9999999999988682-5,0,1.9999999781047113-6,1.32421875,1.9999999999971019-7,0.75,1.9999999649675382-8,0,1.9999999999971019-9,1.9997353022039832,-7.03125-10,0.75,-7.5-22,1.9435724647482853,1.9999999999999993-23,0,1.9999999999999993-18,1.7578124999999996,019,0.75,07,1.4999963022145069,06,1.38555908203125,0-21,0,1.999735302203983218,1.2695846557617188,05,1.455296516418457,010,0,017,0,016,0.75,04,1.4993494786965087,013,0,012,0,1.6948242187511,0.9375,0-1,-7.5,0.75-13,0,0-14,1.8749999999993041,0-16,0,0.75-17,1.8749999999993041,0-2,-6.937500000001043,08,0,1.51171875-19,0,0-20,1.4999999999999996,00.750.50.051-2280.76923076923077