LUMOZ

We started LUMOZ as our final-year university research project. It combines augmented reality and 3D in a live-streaming environment, for anyone who broadcasts: social media creators, teachers sharing knowledge online, online event planners, news presenters and mobile journalists.

Over the lockdown years many young people turned to social media as a source of income, streaming and making videos every day. We wanted to give these young media entrepreneurs a tool that pushes their creativity further and helps them bring new kinds of content to their audiences.

What it does

LUMOZ lets you bring 3D models into a live broadcast with AR, and interact with them on camera. It is a web application that anyone can use at any time: provide your camera feed, then add a model from the built-in 3D library or import your own.

You can interact with the model using hand gestures during the broadcast. An IoT device and mobile app called Lumoz Remote connects to the camera and keeps its movement in sync with the scene.

Architecture

Technology

LUMOZ is built entirely with JavaScript. WebGL handles the 3D objects and animation, socket connections keep the main application and the IoT device / app in sync in real time, React powers the web app, and FFmpeg encodes and streams the video.

The platform

The team

I'm very thankful to my team for their hard work.

• Pubudu Arosha
• Bawantha Thilan
• Jayani Gankanda

Recognition

LUMOZ won the Merit Award for Tertiary Student Projects (Business) at the National ICT Awards (NBQSA Sri Lanka), and the Best Track Research Paper award at ICAC, the International Conference on Advancements in Computing.

Watch the presentation