To turn off Music and Sounds click on the settings wheel in the upper right corner and choose the correspondent options.

You can also enable or disable Music and Sound Effects on the playing field by pressing the Menu button and choosing the needed options.