That's funny. There are a couple songs I'm not a fan of on that album but "Black Man" isn't one of them.

.

A lot of Stevie Wonder's music is ideological. If that's your reason for not liking that particular song I'm kind of surprised you listen to him at all. Anyway, I really don't like "Village Ghetto Land" and "Isn't She Lovely" because I've always found both kind of boring, though the latter has grown on me a bit just by virtue of its inherent sweetness.

Edit: I just was looking at the track listing and remembered I also don't like "If It's Magic".

I think the bad tracks on an album are sort of part of the history and context of the artist in question.
One song doesn't take up all that much space either, so as long as it's an album that I mostly like, I'll keep it all.

If an album is so bad there's only 1 good song, then I'll delete the album and put that song into a big, messy "good songs from bad albums" folder. But it has to get that bad before I delete songs.

Sometimes I even end up liking a supposed bad song, and I'll often listen to an entire album without skipping. It's just part of the experience to me. I don't skip bad scenes in movies either.