I eat whatever I want, and only work out occasionally, but I've never felt misery that was directly related to my state of physical being, and I'm not THAT fat...
I have felt miserable because I didn't have a bacon pizza in the immediate vicinity of my face, however.
I do eat a (mostly) balanced diet, btw.