Bringing ‘The Wizard of Oz’ to Life: Sphere’s Innovative AI Experience
Introducing a New Era for “The Wizard of Oz”
The beloved classic “The Wizard of Oz,” released in 1939, is not just remembered for its enchanting story and memorable characters; it is also significant for its innovative use of color in storytelling. Directed by Victor Fleming, the film masterfully transitions between black-and-white scenes in Kansas and vibrant color in Oz, creating a unique viewing experience. Today, it is making history again as teams from various sectors, including film and technology, work together to bring this iconic tale to a modern audience in innovative ways.
AI-Powered Transformation
On August 28, 2023, at the newly opened Sphere venue in Las Vegas, a reimagined version of “The Wizard of Oz” will debut, showcasing the advancements made in artificial intelligence. Major players like Google DeepMind, Google Cloud, and Warner Bros. Discovery have come together with skilled professionals to transform this classic into an immersive experience. Using generative AI, they will re-create the film in a manner that fills the colossal venue’s 17,600-seat spherical space.
The Technical Challenges Ahead
This ambitious project is not as straightforward as simply applying AI techniques to old footage. According to Buzz Hays, Google Cloud’s global lead for entertainment solutions, the team begins with original four-by-three images shot on 35mm film – which consist of three separate negatives. It’s essential to adapt this grainy content for Sphere’s massive 160,000 square-foot screen. This endeavor involves collaboration among visual effects artists and AI models to ensure that the characters and settings remain true to the original while providing a new, engaging viewing experience.
Addressing the Challenges
One of the significant hurdles was enlarging the film’s original grainy images for display on Sphere’s 16K LED screen, which is the highest resolution screen currently available. Traditional CGI might handle basic scaling, but it struggles with dynamic elements where characters are removed or displaced during editing. For example, the scene where the Cowardly Lion meets Dorothy and her friends requires meticulous attention to detail to ensure all characters are well-integrated into the expansive setting.
AI Techniques Employed
To tackle these challenges, the project uses advanced AI tools, including Veo, Imagen, and Gemini. These technologies assist the team in a few key areas:
- Super Resolution: AI tools enhance the quality of the original film frames, transforming them into ultra-high-definition visuals that are more vibrant and detailed.
- AI Outpainting: This technique expands scenes to fill in gaps left by camera cuts, ensuring continuity in the storytelling.
- Performance Generation: Incorporating elements from the original performances into these newer, expanded environments creates a seamless experience for the audience.
Leveraging Additional Resources
In addition to utilizing AI, the project team significantly benefited from having a wealth of supplemental materials at their disposal. They accessed production notes, shooting scripts, photographs, and set plans, allowing them to fine-tune the models used in AI applications. This extensive research ensured that every detail, right down to Dorothy’s freckles, was accurately represented and aligned with the original film’s essence, collaborating closely with Warner Bros. to maintain continuity.
A Leap of Faith
As this groundbreaking project continues to evolve, team members express their astonishment at the progress made and excitement for what’s to come. Jim Dolan, Executive Chairman and CEO of Sphere Entertainment, describes this venture as a leap of faith. He emphasizes the unpredictable nature of innovation and the unique experience that “The Wizard of Oz at Sphere” will provide.
