I don't know any of the songs, but I should try with Current 93 one day.
Billy Joel - Get It Right The First Time
Rivers Cuomo - Blast Off!
Dinosaur Jr - I Want You To Know
Smashing Pumpkins - Dolly Vita
Pavement - Newark Wilder
Jason Mraz - Too Much Food
Bruno Mars - Grenade
My Bloody Valentine - Soon
Weezer - Pink Triangle
Stone Temple Pilots - Interstate Love Song
Spot the odd one out