House Concert AR

1 0
  • 0 Collaborators

Me and fellow Innovator Peter Ma along with our team (Cindi, Ben and Brian) WON the grand prize for the Verizon 5G Challenge in the Capitol 360 Hackathon in December 2018! An AR application for bringing the concert experience into your home using volumetric captured video content. ...learn more

Project status: Concept

Virtual Reality, Mobile, Networking, Graphics and Media

Code Samples [1]

Overview / Usage

Music videos are great, but it’s pretty much the same format since the 80's, just on smaller screens now. We want to create the next evolution of music video, giving immersive and interactive experience in AR and VR, and we’ve made 3 major improvements.

  • The music video now is in AR, using volume metric video capture so you can navigate around the performance in the comfort of your home. This is possible through a 5G network as this short 3D video is over half a gigabyte.

  • You may realize in most music videos the artists switch themes every few seconds. Our 2nd improvement gives users the power to switch themes, since the video is no longer static. Users can simply swipe to swap out themes in near real time, the 5G networks allow us to download a new themes that artists made very quickly. It also allow artists to make new themes for their older songs to keep the songs fresh. Currently you’d have to make a new music video after your song becomes a hit, that’s why we sometimes see multiple music videos for one song.

  • Because each environment theme features items curated by the artists and scene designers, most of the stuff in a virtual scene can be purchased in the real world. Simply click on an object, or the artists' clothing to see a pop up for more information about the item, as well as how to purchase it. This creates new monetary benefits for artists, scene designers and record labels, as everyone will get a cut. Because music is the driving force of our culture, we buy things based on culture leaders. We believe House Concert will be the next evolution of Music Video. We built House Concert as an AR phone app but it can easily ported to VR, Magic Leap, and other platforms.

Methodology / Approach

Inspiration:
In anticipation of 5G networks allowing vastly increased bandwidth in the near future, we set out to create the music video of the future.

What it does:
House Concert is an AR application for bringing the concert experience into your home using volumetric captured video content.

How we built it:
We built the application in Unity with assets stored on AWS, which are loaded dynamically.

Challenges we ran into:
Building a 5G focused app without 5G for most of the development process.

Accomplishments that we're proud of:
We were able to create a JamesDavis house concert experience with great results.

What we learned:
We learned about how volumetric video capture and 5G networks work.

What's next for House Concert:
Secure permissions from the artist and stakeholders to release the app to the public.

Technologies Used

Built With unity, c#, Verizon 5G, spatial audio

Repository

https://devpost.com/software/policy-pal

Comments (0)