The only way to choose neither side would be to resign your commission. Otherwise, you would be refusing to obey orders. Lee resigned his commission after Virginia seceded but before he received orders because he believed it would not be honorable to do so if under orders.