The stem doesn't go in just one way. There's splines on the end of the stem that go into the steering flag. My guess is when you put the stem back in, you were off one or two teeth. Take the stem back out, make sure the tires are straight, then put in the stem straight. If you can't get it just right, fine tune with the tie rod adjustment.