Not normally a factor.
Stand taller when hitting a driver. Your stance should be wide with the ball toward your left heel. Your shoulders should be parallel to the target line with the back shoulder some five inches lower than the front shoulder.
You could have the ball too far back in the stance.
Your backswing might be too much "up" and not enough "around." The club should be over your right shoulder at the top and not over your head.
Keep your taller posture without leaning toward the ball. It should feel like the clubhead is swinging more level to the ground and not so much up and down.
Ball flight tip sheets