For this project, I took a bunch of minigames (small tasks played either alone or against other players) from Mario Party and New Super Mario Bros for the Nintendo DS and used image recognition python packages to play them for me. The general framework is the same for every game:

1. Capture the screen
2. Parse image to extract certain elements
3. Depending on what's extracted, move the mouse or press some key to perform an action

The goal of this game is to sort the enemies into their correctly colored bins before they go away.

This game is essentailly whack-a-mole, but with other obsticles to avoid hitting. A great task for Computer Vision!