don't change/swap horses in midstream

Don’t change methods or leaders in the middle of a crisis. Although originating a quarter of a century earlier, the expression became famous through its use by President Lincoln in 1864 when he learned that his renomination for a second term was being backed by the National Union League. Several versions of his speech were recorded, some having it change and others swap.