You may still went to keep a few thousand scout in your cities. A few player will tested your city with one or ten scouts. With this being said, if a player send more ten thousand scouts he will probably attack you at some point. You better by ready and tell your alliances.