Equal pay for equal work?

This post from Greg Mankiw discusses a January report from the Congressional Budget Office (CBO) that concludes federal employees earn more than private-sector employees of the same credentials.
Is public service deserving of a premium salary?