visionOS 2: Apple Vision Pro Set to Get Major Upgrades and a Critical Security Fix
- A critical security flaw that exposed what Vision Pro users are typing has been patched with visionOS 1.3—here’s what you need to know.
- Additionally, Apple Vision Pro is about to get a major overhaul with visionOS 2, just days away.
- visionOS 2 brings new gestures, spatial photo magic, and more—get stuck into the details now!
Photo via UploadVR // Apple Vision Pro’s new visionOS 2 brings a revamped user experience with enhanced hand gestures and customization options.
Summary
- visionOS 2 Launch: New gestures, enhanced hand tracking, and spatial photo capabilities. Read on for more details about visionOS 2.
- Security Fix: Apple has patched the GAZEploit vulnerability in visionOS 1.3, covered in more detail below.
- Enterprise Features: In addition, Apple has added access to Vision Pro’s cameras for business applications.
What’s New in visionOS 2?
- Hand Gestures & Control: visionOS 2 introduces two new hand gestures. Opening your palm and pinching your fingers will bring up the app launcher, while facing your palm down reveals a new hand-locked information bar displaying time, battery life, and connectivity. Pinching this bar will open the Control Center
- Spatial Photo Conversion: The update allows users to transform any 2D image into a 3D Spatial Photo using advanced machine learning technology, adding depth and immersion to visual memories
- Improved Mac Virtual Display: Later this year, visionOS 2 will enable a virtual display equivalent to two 4K monitors side by side, utilizing eye-tracked dynamic foveation for enhanced clarity
- Enhanced Hand Tracking: With a boost to hand tracking accuracy and speed, visionOS 2 provides developers with hand poses at display refresh rates and optional predictive features to lower latency
- Room and Plane Detection: The update improves room tracking and introduces detection for slanted planes, making virtual interactions more seamless and contextually aware
- Safari Enhancements: Safari now supports fullscreen video playback in a virtual environment and WebXR is enabled by default, streamlining access to immersive web content
- AirPlay Integration: The Vision Pro will now function as an AirPlay receiver, allowing content from iPhones, iPads, or Macs to be cast directly to the headset
- New Features for Enterprise: visionOS 2 grants enterprise users access to Vision Pro’s passthrough cameras for custom computer vision applications, though these features are restricted to proprietary in-house apps
Vision Pro Security Flaw Addressed
In a related update, Apple has addressed a significant security vulnerability in the Vision Pro. Discovered earlier this year, the flaw—dubbed GAZEploit—allowed unauthorized access to what users typed, including sensitive information like passwords and messages. Researchers from the University of Florida and other institutions found that by analyzing eye movements, they could reconstruct typed inputs with up to 92% accuracy.
According to WIRED, Apple was alerted to this vulnerability in April and swiftly patched it with the release of visionOS 1.3 in July. The fix involved suspending the Persona avatar during virtual keyboard use to prevent the exposure of typed data.
For detailed information on these updates and features, check the official Apple release notes and developer documentation.
Photo via MarketWatch // The Apple Vision Pro takes center stage during its grand unveiling, showcasing its sleek and unique design.
Recommended by the editors:
- Apple Smart Glasses: Rumors, Leaks, Release Date, Features, and More
- M5 Apple Vision Pro: Launch Date, Pricing, Features, and More
- It's Official: Apple Confirms New MacBooks Are Coming
- New Apple Products Are Coming This Week: Rumors, Leaks, and More
- Apple Hits Pause on Vision Pro Development — Is the Headset in Jeopardy?
Published to Apple Scoop on 13th September, 2024.
