Introduction to Virtual Reality

XR Performance: Real-Time Inference Optimization

Optimizing AI inference for XR devices — model quantization, NPU acceleration, hierarchical serving, bandwidth optimization for real-time 60fps rendering.

AI + XR Integration Patterns

Practical patterns for integrating LLMs, VLMs, and neural networks with immersive XR environments — from spatial AI assistants to real-time scene understanding.

Virtual reality (VR) sits at the intersection of computer graphics, human perception, and interaction design. It's not just strapping a screen to your face — it's the art of convincing the human brain that a computer-generated environment is real enough to inhabit.

What Is Virtual Reality?

There is no single definition. Three influential ones:

Ivan Sutherland (1965), the godfather of computer graphics: "In the ultimate display, one will not look at that world through a window, but will be immersed in it."

Steve Bryson (1996): "Virtual Reality refers to the use of three-dimensional displays and interaction devices to explore real-time computer-generated environments."

Thies Pfeiffer (2012): "Interactively generated 2nd order multimodal sensory perceptions, which are taken as 1st order perceptions by humans."

Despite the differences, three features are universal: immersion (the perception of being present in an environment), interaction with that environment, and real-time responsiveness.

Computer Graphics Foundations

VR builds on computer graphics. Every 3D object in VR is constructed from the same primitives: vertices (points in 3D space), edges (lines connecting vertices), and faces (triangles forming surfaces). The Utah Teapot — the "Hello World" of 3D graphics — demonstrates these concepts.

Coordinate Systems

Different graphics APIs use different coordinate systems:

Converting between systems is essential when integrating assets from different tools.

Human Visual Perception

Understanding the human visual system is critical to building comfortable VR.

Key constraints:

• The human eye has a temporal resolution of ~60 Hz — frame rates below this cause visible flicker
• Natural field of view is approximately 170° horizontal × 110° vertical
• Stereoscopic vision relies on two offset viewpoints to create depth perception

Simulator Sickness

When the visual system and vestibular system disagree, simulator sickness results. Symptoms include nausea, headache, dizziness, blurred vision, and fatigue — measured by the SSQ (Simulator Sickness Questionnaire, Kennedy et al. 1993).

Mitigation strategies: high frame rates (≥90 Hz), accurate stereoscopic rendering, dynamic field of view adjustment during motion, and minimizing latency between head movement and display update.

A Brief History

Jaron Lanier is often called the "father of VR" — he coined the term and founded VPL Research in 1984, producing the first commercial VR hardware (the DataGlove and EyePhone). Before Lanier, Myron Krueger used the term "artificial reality" for his interactive installations in the 1970s.

Key milestones:

• 1968: Ivan Sutherland's "Sword of Damocles" — first head-mounted display
• 1984: VPL Research founded, term "virtual reality" coined
• 1991: Virtuality arcade machines bring VR to the public
• 2012: Oculus Rift Kickstarter reignites consumer VR
• 2016: HTC Vive and Oculus Rift CV1 launch consumer room-scale VR
• 2020: Oculus Quest 2 makes standalone VR mainstream
• 2024: Apple Vision Pro introduces spatial computing to the mass market

The Reality-Virtuality Continuum

Milgram and Kishino (1994) introduced the Reality-Virtuality (RV) Continuum, placing environments on a spectrum:

Real ──── Augmented ──── Augmented ──── Virtual
Environment    Reality        Virtuality      Environment

Augmented Reality (AR) overlays digital content onto the real world (phone AR, HoloLens). Augmented Virtuality (AV) brings real-world elements into virtual environments. Virtual Reality (VR) is fully immersive and computer-generated.

Rauschnabel et al. (2022) extended this to "xR" — an umbrella term covering VR, AR, MR (Mixed Reality), and everything in between.

VR Devices

Modern VR devices fall into three categories:

Motion Tracking

Tracking systems determine where the user's head and hands are in 3D space:

• Outside-in: External sensors (cameras, lighthouse base stations) track the headset — high precision, limited play area
• Inside-out: Cameras on the headset track the environment — no external setup, lower occlusion robustness
• 6-DoF (degrees of freedom): Position (X, Y, Z) + orientation (pitch, yaw, roll) — the minimum requirement for immersive VR

Immersion and Telepresence

Immersion is the objective, technical capability of a VR system: display resolution, field of view, refresh rate, tracking precision, audio quality.

Telepresence (or "presence") is the subjective feeling of "being there." It's what happens when the technical immersion is good enough that your brain suspends disbelief.

High immersion doesn't guarantee presence, but low immersion makes it nearly impossible. The sweet spot: ≥90 Hz refresh, ≤20 ms motion-to-photon latency, ≥110° FOV, and accurate positional audio.

The Metaverse

The metaverse extends VR beyond single experiences into a persistent, interconnected virtual universe. Key characteristics:

• Persistence: The world exists and evolves whether you're logged in or not
• Interoperability: Assets and identities move between experiences
• Economy: Digital goods, currencies, and property rights (blockchain/NFT layer)
• Social: Shared spaces for real-time interaction

Major corporate players include Meta (Horizon Worlds), Epic Games (Fortnite ecosystem), and Apple (Vision Pro spatial computing platform).

Download the Full Presentation

For a complete deep dive with visuals and additional detail, download the university lecture slides:

→ Download: Introduction to Virtual Reality (PDF)