Martha Madison's Marvelous Machines is a learning game created by Second Avenue Software to help middle school girls gain scientific intuitions and develop understanding of the properties and uses of simple machines. In 2011, during the pilot phase of the game's development, the game was played by a group of middle school girls and their game play was studied. This paper describes the results of the analysis of the data collected during the pilot, which included evidence of engagement in the game, as well as some increased affinity toward STEM practices. Also encouraging in the analysis was the discovery that the participants were noted to have high levels of communication and collaboration during the game play.