I'm thinking that the 'That's The Bitter' part would be spoken at the ned of the song between a big guitar solo or something. Like backing vocals. Is this how it is intended?

Yes it's meant to be like that...or just sung really fast...