Did you adjust your scope for shots 3 and 4?

Is it a common problem for your rifle to not hold zero?