just a couple weeks ago i was home sick for 3 days, and i spent half of that time methodically rating every single track on the 250 albums i have on my computer. i set up hotkeys in foobar to make it easier. and i'll tell you what - i'm so glad i did it! making autoplaylists that only play 4 and 5 star tracks is awesome. plus, i weeded out about several gigs of music that i ended up rating poorly. i just have a 30 gig ipod, so it was nice to clear out some space.
i rated each track relative to other works by that artist, rather than relative to my entire collection. it makes things a bit uneven overall, but it works out in the end, and it was much easier to do that way. i just threw an artist on shuffle, and went through one by one.
5 - best tracks. pretty obvious.
4 - great. i can sing along or otherwise dig it. i want these tracks in my shuffle.
3 - average. i don't want them in general rotation, but if i'm listening to an artist on shuffle, i definitely want to hear them.
2 - mostly for intros, vocal tracks, etc. i don't want to hear these at all unless i'm listening to an album start to finish. also, songs i really, really dislike get 2 stars.
1 - other. not tracks i dislike, but stuff like comedy, spoken word, or other things that i want to separate and keep out of my playlists, because i only listen to them deliberately. oh i also use this for one-track live sets, or things like sets recorded off of radio one.
i also have all my albums tagged with the type of release it is - studio album, EP, single, live, bootleg, etc. this helps me keep autoplaylists tidy since i can keep live and bootleg tracks from appearing. live stuff is best listened to straight through.
in the end, this is what comes out. i also have lyrics for about 3/4 of all my tracks now, and i'm slowly filling out the rest. i have high-res album art for 95% of my albums - the rest are just medium-res. i also have artist photos for everything except for compilation albums. it's been a hell of a lot of work getting everything tagged, but it really is fantastic having such a tidy music collection