either buff them... or remove them
personally, how invasions are currently I just find them annoying
I normally in my worlds just let them spawn and then get a few 10's of thousands of miles away from them, and they never annoy me again
either remove them entirely
or let there be more then 1...