I have no neighbours, they have all been removed, so fortunately I don't have that problem, but if I did, I definitely would have no problem farming any NPCs they build. My troops need to eat, after all.