Wow, I'm surprised so few people just go out and buy music. I like used CD stores, music stores and online music stores.
I rely on blogs to learn about new artists. I get a lot of CDs from the library, though. There's something much more rewarding about having the actual CD in your hand... even if the case is held together with tape and the disk is all scratched up.