That's because on each of the three preceding holes, the player whose low-ball score counted as the team score is "eliminated" (he still plays, but his score can't be used). After the fourth hole, the rotation starts over again with all players eligible.
See Eliminator for examples and variations.

