If Americans are "really, really down," as President Joe Biden suggests, it's hardly surprising.