Apple researchers have developed LGTM, a framework that can render high-resolution 3D scenes more efficiently. This technology could be particularly relevant for the Apple Vision Pro.
Apple's AI research regularly yields results that don't immediately translate into products, but reveal the company's technological direction. With LGTM, Apple researchers have now introduced a framework that addresses a fundamental problem in 3D graphics: rendering high-resolution scenes in real time. For a company that has incorporated one of the world's most pixel-dense displays in the Apple Vision Pro, this is more than just an academic exercise.
The problem: 3D rendering scales poorly
At the heart of the research is a technique called Feed-Forward 3D Gaussian Splatting. Put simply, this method makes it possible to create a three-dimensional scene from one or a few photos, which can then be viewed from different angles – and all this in seconds, without time-consuming individual optimization for each scene.
The problem: The higher the resolution, the more expensive the process becomes. At 2K or 4K resolution, the computational effort increases quadratically. This quickly makes the technology impractical on devices with extremely high-resolution displays – such as the Apple Vision Pro with its approximately 23 million pixels.
What makes LGTM different
LGTM stands for "Less Gaussians, Texture More" and describes the framework's core approach: The geometric complexity of a scene is decoupled from its visual resolution. Specifically, this means that the system learns the rough structure of a scene from low-resolution images with less computational effort, while a separate network overlays high-resolution textures.
The result: detailed 4K scenes without the usual increase in processing power. LGTM is not a standalone model, but rather an extension that can enhance existing feed-forward methods. In the study, the researchers demonstrate that texture and detail quality noticeably increase with significantly lower resource consumption – especially for fine structures and text.
Relevance for Apple Vision Pro
The Apple Vision Pro delivers more pixels per eye than a 4K television. While the displays can reproduce this resolution, the fast and precise generation of 3D scenes at this quality remains a computational challenge – even with the M5 chip used in the current generation.
LGTM could be a key solution here. By more efficiently separating geometry and texture, immersive 3D environments could be rendered faster and with greater sharpness, without overloading the processor. Potential applications range from more realistic passthrough experiences and more detailed spatial photos to more complex AR applications.
Apple: Between research and practice
As with many Apple research projects, it remains to be seen whether and when LGTM will be incorporated into specific products. The study was conducted in collaboration with the University of Hong Kong and is published on Apple's machine learning research page. Comparison videos are already available on the project page, clearly demonstrating the difference in quality with and without LGTM.
One thing is certain: Apple is strategically investing in technologies that make high-resolution 3D rendering more efficient. LGTM is supplying another component for the further development of the Vision Pro platform – including a potential 2nm R2 chip – which could further improve the integration of software and hardware in the future. (Image: Shutterstock / Alones)
- Apple disables Payments in Russia for App Store and Services
- Apple TV: First Teaser for the psychological thriller series Cape Fear
- Apple's Fitness Chief Jay Blahnik will retire in July
- Amazon wants to buy Globalstar – what threatens Apple
- Fake WhatsApp containing spyware: Meta warns 200 users
- Apple Sports is now showing all the Teams of the FIFA World Cup 2026
- iPad Air 3 lands on Apple's vintage list
- AirTag 2: Update improves stalking protection
- Tim Cook's memo on Apple's 50th birthday
- AirPods Max 2: Apple still sees potential in the H2 Chip
- Tim Cook in an interview: "It is definitely still his company"
- AirPods Max 2 available starting today
- Apple patches iOS 18 against DarkSword exploit
- Iran war threatens India's smartphone exports – Apple has the advantage
- MacBook sales in 2026: Apple defies the market slump
- ChatGPT in CarPlay: OpenAI brings AI chat to the car
- Apple declares three devices vintage and obsolete
- NASA Artemis II: Rocket launch is recorded immersively
- iOS 26.5 Beta 1: All new features at a glance
- AirPods Max 2: First Reviews at a glance
- Apple introduces privacy rules for third-party providers
