See if turning around in a circle, or going to other direction helps. And good that you are kinda pushing from the shoulder or butt, rather than trying to pull from the neck.
For a while it may be that you cross back-and-forth across the street a lot, or walk up and down a very short stretch of sidewalk, but it will get better... but that could be months to years, maybe not just days or weeks. (just so you are prepared... we had a really nervous walker)