Out of sync sensory inputs can cause sickness. Car sickness and sea sickness for example. It happens when our vestibular system doesn't agree with our other senses. VR and AR will have the same issue, but for an additional reason: the vergence (angle) and accommodation (focus) of our eyes don't agree in those environments. Wired wrote about this.