Player Interfaccia per piattaforma video

Press Kit

Unique Properties

Player redefines video content by enabling audience participation in XR. While traditional platforms limit interaction to "likes" or "comments," Player turns viewers into active participants. It allows users to explore 3D motion data, follow along, and share their actions. With generative AI, users can create avatars and backgrounds, making participation accessible to all. This transforms video enjoyment into an immersive, multidimensional experience.

Dimensions & Packaging

This project focuses on an AR user experience within XR and is designed to be compatible with HUD-type devices. It is expected to function seamlessly on devices like Meta's Quest or Apple's Vision Pro. However, AR glasses in the form of smart glasses may currently face challenges in achieving full technical implementation.

Tags

XR, AR, Video Platform, UI, Interaction, Participant, Play

Production Technology

Videos uploaded to Player include motion and sound tracking. Whether recorded with XR devices or standard cameras, movements within the video are converted into 3D motion data to facilitate easy participation. Additionally, a generative AI-powered UI allows users to create avatars and environments, enabling them to join videos in their desired appearance. This combination of technologies ensures an accessible and personalized experience for all participants.

Design Challenge

The main challenge during the project was developing a method to extract 3D motion data and effectively visualize it. Seeking advice from experts, I learned that motion tracking was feasible and adopted active use of 3D tools, which ultimately allowed for effective representation.

Research

Type of Research: Exploring user video participation possibilities through 3D motion tracking and generative AI in XR environments.
Research Objective: To explore dynamic possibilities where users transform into active participants through modern technological integration.
Methodology: Project functions derived from in-depth user interviews and insight clustering.
Data Collection and Research Tools: Insights gathered through one-on-one in-depth interviews and collective opinions collected via online surveys.
Participants or Experiments: Conducted primarily with Gen-Z users in their teens and twenties.
Results: Most participants acknowledged the increasing trend of video participation but agreed on the limitations of current video platform features. They expressed that generative AI, enabling changes in appearance or environment, would make video participation more engaging and enjoyable. There was also significant demand for customizable avatar and filter features.
Insights and Impacts: Current video platforms, despite their dynamic content and user expectations, offer only limited functionality, rendering video consumption a static activity. Integrating XR features and generative AI could encourage more active participation from viewers.
Business Impacts: Both participants and creators are likely to spend more time on the platform, increasing app engagement and session duration, which would naturally lead to higher ad revenue and other supplementary income. This would improve video quality and user reactions, creating a positive feedback loop.
Real-Life Phenomena: Viewers will no longer consume videos passively through static comments. Instead, they will enjoy watching participation videos that capture how others laugh, cry, or act, making video consumption a more dynamic and engaging experience.

Inspiration

As someone who enjoys video content and wants to join challenges, I often felt burdened by the need to edit videos and hesitant to show my face or body. Following complex actions in videos also proved challenging. To address these struggles and explore new possibilities for enjoyment, I aimed to use generative AI in XR to create a solution. I look forward to a day when everyone, regardless of age or background, can enjoy videos in their own way, with the appearance and actions they choose.

Project Duration

This project commenced in January 2024 in South Korea and was completed in April 2024 in South Korea.

Operation Flow

Users who find a video they want to participate in first set up their desired environment. After customizing their avatar and selecting a background, they can start recording. Utilizing 3D data provided by the video, users can accurately follow actions, including details that are usually hard to notice. This can be applied to dancing, building LEGO, reaction videos, and more. Once recording is complete, users can easily edit their participation and share their experience with others.