You built a nice place. Oddly, it attracts dysfunctional people who attempt to tear it down and poison your harmony.
You cannot simply retreat: you must use the nice space as a power source. Let them in or fight them off, but hiding enables the destruction.