Instant handover can only be applied in order to abandon a colony. It can not be used to get colonies back, or to cancel the abandonment.