AI and Machine Learning are the hot topics this decade, not only in industry, but also in computer science education, as they contain many exciting and interesting new concepts. However, many educators think these topics are “magical”, too complex, and that they can’t be taught in classrooms.
But Machine Learning does not have to be crazy magic! Using the Snap!-environment, which is perfect for creating games with, we can use Machine Learning to teach an AI how to beat us at our favorite games.
We use Reinforcement Learning implemented entirely in Snap! itself, without relying on external libraries, JavaScript-wrappers, or servers. Because of this, the learning algorithm is fast, intuitive, simple, and can easily be visualized for easier understanding. It also means that our approach can be transferred to many other game settings, simulations, problems, etc.
Explore the magic with us!
data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAKAAAAB4CAYAAAB1ovlvAAAAAXNSR0IArs4c6QAAAARnQU1BAACxjwv8YQUAAAhVSURBVHhe7d1bbFN1HAfw32m7dXTAHAIDiUPwBiSKQYMJgiEGjG8+aDS+YEx80AfQKGDiJYD6wGUSMgwx6BMqUUgUE02QiyBXr6DOB8Sh3LqxzV26dVu7taf+f/9zDpz13m7tv5fvJynnf067s3///fZ/OSup1nAqEiHI2KoHhs1Sehp/qTBLYJdxAO0NX46NmmnwoiGIIznM7XXcwNE3i73MovcBMjUigIkClSxoCCGMhgwghyhVkBA0SCWb1UTMEAyQLU0zCxnIaQDdTrNQBlItLvh+LEBi5TSAwbBZKCHJQhQvZAhecvIyTLbzu3JuWHubIWDZG3EdMNMgouFhtOJeiI4XRIQNcgGr4DLGHU2206+xkvRPcVbl0PuVnkIZ5ZL2gFwhhA9yKeMPI0DxyXSYzWengzkgxMjn3BABLGH5DFK2EMACV+p/zkQAC1wp/jnTrqQDaA1BxTAUlQJ8HMsmF4ErleEw1So328tv2Xwcq6Quw6QTunK7rhmvTaw2SHZfvpREADPt7co5hIX23Is6gJkGL1qpBpFf0CxGQyWwCi5BxRI+hgCWqGIZ1xDAEpXNilQFBBCUKskAplpc8P3lthIuVEUdwGQhihcyBK/wlNx1QASsuOADqaAUFiFlqlC6HQSwTEVfprEHMp/ZRABBsgcyn5cQEUBQCgEEpRBAUAoBBKUQQFAKAQSlEEBQCgEEpRBAUAoBBKUQQFAKAQSlEEBQCgEEpRBAUAoBBKUQQFAKAQSlEEBQCgEEpRBAUAoBBKUQQFAKAQSlEEBQCgEEpRBAUAoBBKUQQFAKAYQx17PxdooE+8y95BBAGHNLn7qFlt62w9xLDgGEMffP3L20YOa3tHDGJ+aRxBBAGHO9wWkU0itpSf1OcmrJv88PAYSc+OjMHrmdXP2P3CaCAEJOLZ/dYJbiQwBBKQQQcurghdVmKT4EEHLi+QVPmaXkEEDIiRdfbKa9Pz1Hbf13m0fiw1d1gVLoAUEpBBCUwhCsyOpFI78Qa8tJnbRi+Z79MYQeMM84eHzbvJzkLXJyldyujrwcE8pygB4wz/R1N0K2Zv0qs3RDA20rq54QPaAia9YZ4XMsbhyxLTcIoELaQ42knzCCaG3XLi7ClyTYS5EDa4mG+4l6r5gH04MhOMeseZ1oZ7llfIyP6mL+Z+Ew8nyQzX+rlVa8a3yapKD1d1Bk22yaoPnlLj/DSvH+6Xr6MGmzHpHHUkEAc8ya8609ODKEr+gvjRh2OXwcQmZ/XMHq9ZL+wQKqCbdTjVtkcYgoJKrN5cv+StKe3E3avCfMByeGITiHrN7vNRE+udI199c85KAtGxrlt5RbNw4jb4sifIL+9QtU72onXVS3XYy8FU4jfKx+/BBFDr1u7KSAAObBJhE+7gEZh3DTsogcgjctE/+IF9DabjlZHOFj2owHKRgiqq0imlptHOMgtpr/F6nKd94opJB+ALlt7DdIiXsz7v34xoHjG/eEFm7GjXwt0NilsBiuuXcsBpHfd5HbxR+/J/KK0A3rRhCnTzDuD1TV8aOMnSQwB8wzaxhmclheJ+Z+5iFrIVIMi5BI02dUt/8ZqhRDL+OhmMPoF3PBaeNFTzjoJu2tgHFnErkJoGhQPuuNpgbG4bNWuowDxxed9RMryblkO4WOrSTXw9tp8/GwuLPwW0/fUEFTx4WoQnTafSJ4E8UcMCxe9zaxKI482kDaolfNRyaWPIB8D1I0Zna9GfshTW5e+wuw4p3PiyJ8FtfbGo2vFAEUvR8H0Ce24WWbxZtrjfmI5LR1hx9PHECANDg6esnR0k16XQ3p024yj6YHq2AYNX3KRArNn5lx+JhjsLnDLApiJul97wgFL3ebB8TwEAqTt+EIBS50yv2eQ+eppfGYLFt8R5updcdJc8/Qua+JWt4/buwkOG/nV03mnqF1xwn5c9eJ2QH/7u4D5+Ru8EqP3Nd5/W8K9wUS1jfsD5L/7FWKDBnHIrxUE1LW1/TfnrPU9uFpWY5uB8bnHVlfsSK01dfSsv04+Y5dkGWuL7eF3eDfHTHnTae+/JhU5/VuPWruxWtfo758G2ozrp9k0w4xMmgH5x2t3vWVt9QQOR3k3fIdhToHyP/rFaq6fbJ8oHfzEQp1DVD/b15y3eyRFQz3DMoKjL//VvKfuUpdXzbJxwxd9ZFnbh31nroogxruHhTn66fOL/6Ie14+h+bUyF1fS+0f/0yD59plyNwzashVO446dp+hQPN/FPi3ixxVLur49FcK9wbI/8Ml8twznYa8PmrZdoz8P1+Ora+oV694sgNNreQ70ix/zvd9MzlrPSnr65k7jQbE8+3e/xcNi/3ha33Ute/P6+1QNWuSCId4IbYazyFefV0T3OSaXE1tO09TUOxzGCqmVNM1EaSwL0B9os6eOXWiDj3U9tGP8o1iPy//rpT1FROvVOflY/4fL1HgoqhDgvaVb9RfrpDmcmbcDq5JHtnuFq5/Ju2grbiPIpoIH4druN34mx7TxNLGdXO1/KWJeOZMpQHxpOzct02ioHiyicScV8y3x905hQbP23pioUocC4jKJsLn4DdCJGz0EunUN5549a26S/zuqPrYaS4HOcWMO9Q1aB6JU1+xkHDPrE3aFvzi8Ytw/TnEOW+0VO3Los8bT6r2Zem0w5RnF1L1PL7mZ2j94FRG7SADaJYBMicCVr/hMXJWV9KlN74hPXBjepQOBBBGjUdQz73Tqf+s1zySPqyCYdR4qM8mfAwBBKUQQFAKAQSlEEBQCgEEpRBAUAoBBKUQQFAKAQSlEEBQCgEEpRBAUAoBBKUQQFAKAQSlEEBQCgEEpRBAUAoBBKUQQFAKAQSlEEBQiOh/50Mt33jk5lwAAAAASUVORK5CYII=data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAeAAAAFoCAYAAACPNyggAAAAAXNSR0IArs4c6QAAAARnQU1BAACxjwv8YQUAAAK1SURBVHhe7cExAQAAAMKg9U9tDB8gAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAgIsajf4AAXBXLv8AAAAASUVORK5CYII=Affe44#Stämme10.010.90Ball2000de:springe
3010monkey1de:tu Nichts
0LABEL will stamp text on the stage at the given font size. The direction of the text is the direction the sprite is facing, and color will match the pen color.de:drucke _ in Größe _
ca:etiqueta _ de mida _
es:etiqueta _ de tamaño _
fr:étiquette _ d'une taille de _
Hello!12de:ist _ leer?
ca:_ buida?
es:_ vacía?
fr:_ vide?
de:behalte Elemente, die _ aus _
ca:manté els elements on _ de _
es:mantener los elementos donde _ de _
fr:garder les items tels que _ de _
1de:kombiniere mit _ die Elemente von _
ca:combina amb _ els elements de _
es:combinar con _ los elementos de _
fr:combine avec _ les items de _
1de:wenn _ dann _ sonst _
ca:si _ llavors _ si no _
es:si _ entonces _ sino _
fr:si _ alors _ sinon _
de:für _ = _ bis _ _
ca:per _ = _ fins _ _
es:para _ = _ hasta _ _
fr:pour _ allant de _ à _ _
110ide:füge Wörter zusammen _
ca:uneix les paraules _
es:unir las palabras _
fr:fusionne les mots _
121de:Liste $arrowRight Satz _
ca:llista $arrowRight frase _
es:lista $arrowRight frase _
fr:liste $arrowRight phrase _
de:Satz $arrowRight Liste _
ca:frase $arrowRight llista _
es:frase $arrowRight lista _
fr:phrase $arrowRight liste _
de:fange _ _
ca:agafa _ _
es:atrapar _ _
fr:attrape _ _
cont3de:wirf _
ca:llança _
es:lanzar _
fr:lance _
catchtagde:fange _ _
ca:agafa _ _
es:atrapar _ _
fr:attrape _ _
contde:wirf _ _
ca:llança _ _
es:lanzar _ _
fr:lance _ _
catchtagde:für jedes _ von _ _
ca:per cada _ de _ _
es:para cada _ de _ _
fr:pour chaque _ de _ _
de:falls _ dann _ und pause $pause-1-255-220-0
ca:si _ fes _ i atura-ho tot $pause-1-255-220-0
es:si _ haz _ y páralo todo $pause-1-255-220-0
fr:si _ faire _ et mettre tout en pause $pause-1-255-220-0
de:Wort $arrowRight Liste _
ca:paraula $arrowRight llista _
es:palabra $arrowRight lista _
fr:mot $arrowRight liste _
de:ignoriere _
ca:ignora _
es:ignorar _
fr:ignore _
de:Liste $arrowRight Wort _
ca:llista $arrowRight paraula _
es:lista $arrowRight palabra _
fr:liste $arrowRight mot _
de:Zahlen von _ bis _
ca:nombres des de _ a _
es:números de _ a _
fr:nombres de _ à _
1101de:wende _ an auf _
ca:mapeja _ sobre _
es:mapear _ sobre _
fr:appliquer _ à _
1de:erzeuge Modell mit Lernrate: _ Discountfaktor: _ Zufallsfaktor: _ Liste verfügbarer Aktionen: _
0.750.90.05de:bestes Verhalten für Zustand: _ Modell: _
maxValuechosenActionactionsZeromaxValue2chosenAction2actionsZeroi201de:hole Q-Wert für Zustand: _ Modell: _
qitem1-1de:Aktualisiere Modell: _ alter Zustand: _ neuer Zustand: _ Belohnung: _ gezeigtes Verhalten: _
-3010monkey31,-7.21875,0.7522,0.75,017,0,0.7516,0,1.6948242187515,0.9375,03,0,02,-7.5,0.75-10,0,0-11,0.75,0-22,1.27734375,013,0,012,0,0.7511,0.75,0-1,0,0-2,0.75,0-14,0,0.75-15,1.1015625,020,0,019,0,0.7518,0.75,06,0,0.755,-7.5,0-7,0,0-8,0.75,0-20,0,0-21,0,0.75-12,0.75,-7.5-23,1.03125,00.750.50.051180