"Does anybody else have this problem? How do you deal with it?"

Yes -- it's human nature. All you can do is focus on one thing at a time. If you are focused on what's important, then you are allowed to not feel guilty. A great man once said "take so much action your conscious brain doesn't have time to fall into its default patterns of worrying".

For help on focusing on one thing at a time, and taking so much action you don't have time to feel bad: http://focusr.co