The AIP also released data on what those 96% of physics PhD's were doing immediately after graduation; over half (56%) take a post-doc, a third take a potentially permenent position, and 7% take an "other temporary" position, which I'm guessing includes things like non-tenure track faculty positions. If we break things down even further we can see that the type of work a new PhD gets hired to do depends greatly on which of those three categories he or she falls under.
Naturally, what one get paid varies greatly between what type of employment you have.
Those that work in the private sector have typical starting salaries between $70k and $100k, while on the other end of the spectrum post-docs in academia typically make between $40k and $50k.
So what's the moral of the story? Getting a physics PhD is a good career move if you don't want to be rich but would like a fairly stable career trajectory.