When people say "The point is…" it isn’t. To declare primacy, to center one idea, is to elevate and exalt one perspective, usually the speakers. Now the conversation is social politics: the point is to support the person by supporting the idea.
Things affect you because you decide to care: you made it about you. Most of your cares are small and serve no one, not even yourself. Equally, you can let nothing affect you and become a stone. How boring. Be aware, be particular.
Productivity is necessary, but don’t forget why you are being productive. Why are you trying so hard? To live well? You can do that right now. Don’t let the "to do" block you from "being" and "becoming."