Ah, I came across a thread about another band with the same name earlier today. This is the band I was looking for. I really like The Horrors. The album didn't live up to the hype but Count In Fives and Sheena Is A Parasite were just genius.
I do think a lot of people concentrate more on their image than their music. They're one of the best-dressed bands I've ever seen but there's more to them than clothes and hair.