Yes, Paul, it's the exact same building: a famous London landmark even before Pink Floyd gave it international stardom.
For nerds, here are some things of note about the building:-
i) built in the 1930s, it was a design challenge to find a style that could make a power station attractive in some way. Sir GGS went for a kind of stripped-down eclesiastical style, with chimneys instead of spires.
ii) it is still one of the largest brick buildings in the world. The scale of it is hard to appreciate, until you look carefully at the surrounding buildings.
iii) it doesn't matter where you look at it from, you always get the feeling that the main entrance must be round the other side. This may be a consequence of the fact that it is actually two buildings, built about a decade apart. Here is a rare snapshot in time, when it was still only one building:-
