ImmersiveSharing

If you wanna see more details, Please see the Paper.

I plan to provide my space dataset which is pre-made Gaussian Splats asset : Please see the links here.

🎥 Detailed Demo Video.

Introduction

• This repository is code of my Undergrad research paper "Enhancing the Experience Sharing through User Attention HeatMaps and 3D Gaussian Splatting in Virtual Reality".
• It aims to enhance communication between users by constructing immersive VR spaces using 3D reconstruction and visualizing shared gaze data through heatmaps.

Demo - Sharer

Data.Collect_Update.mov

Data.Transfer_Update.mov

Demo - Receiver

HeatMap.Show_Update.mov

Environment with Develop

• OpenXR & XR Interaction Toolkit
• DataBase : Firebase Realtime Database
• Unity 2022.3.7f1

What Features Developed?

Compared to the previous project.

• Updated gaze data collection.
• Transfer and Receive Data from FireBase RealTimeBase.
• Visualize a heatmap based on the data you've been sent.
• Gaze Reticle instead of Ray.
• Change Transparent Material.
• Add HandMenu UI

Update Code.

• GazeInteractor.cs
• HeadGazeHeatMap.cs
• FireBaseHeatMapVisualization.cs
• AnimateHandOnInput.cs
• TransparentHeatMap.shader

Pre-check.

• For Gaussian visualization, Clone the original UnityGaussianProject and Copy the package file inside it to the location where the error was found. UnityGaussianProject

• To use the FireBase database, Get your google-services.json and Put it in StreamingAssets, and Don't forget to download the FireBase Unity SDK. FIREBASE TUTORIAL

• If you want the Demo-like environment, Please download the Gaussian Dataset from the link above.

References

• 3D Gaussian Splatting
• UnityGaussianProject
• HeatMap Shader
• Gaze Reticle
• HandMenu UI

Citation

If you use this repo in your research, please consider citing the paper as follows:

@inproceedings{kim2025ImmersiveSharing,
  author    = {KyoungTae Kim and SeongKi Kim},
  title     = {Enhancing the Experience Sharing through User Attention HeatMaps and 3D Gaussian Splatting in Virtual Reality},
  booktitle = {Proceedings of HCI KOREA 2025},
  year      = {2025},
  url       = {https://www.dbpia.co.kr/journal/articleDetail?nodeId=NODE12131686},
}