Your subconscious will remind you incessantly of open loops. Too many of those and your mind will feel like a web browser packed full of open tabs. Fail to close those tabs in time and your brain will grind to a halt. It might even crash.
Keep a record of the tasks you have declined to perform. By writing those decisions down, you turn them into concrete, completed tasks. Your subconscious will close the loop and grant your mind some peace.
Written apologies can work the same way, even if you never send them out.