That's not just an old cliche or internet meme. It's totally true.
If I'm not actively doing something, something is not getting done. And the time I spend not doing something will just be transferred to later. It's that much later I'll go to bed and/or that much time I'll spend thinking about that something not being done.