I usually send 1k ballistae to avoid that situation. That usually happens though.