Well... I was putting up a land claim and noticed it was 3 squares away from the fence and I thought... I wonder if I can boot them over, and what would happen.
Essentially nothing after the spawn limit is reached. Pretty cheesy, but it worked as expected.