Ongoing projects
Adaptive Bitrate Streaming for XR Cloud Gaming Jan 2023 – present
[Aalto University and HKUST]: Design and develop an end-to-end architecture for real-time video streaming in VR cloud gaming
Adapt bitrate and quality non-uniformly to underlying network conditions
Fair evaluation against the SOTA solutions.
NVidia Coding WebRTCReinforcement LearningFoveated Encoding
Gaze-Adaptive & Foveated Streaming in XR Sep 2023 – present
[HKUST, Hong Kong]: R&D on real-time multimedia communication and foveated rendering and video encoding for low-latency streaming
Enabling technologies: VR, AR, Unity
Foveated RenderingFoveated Encoding NVEncCloud XR
✅ Completed projects
Adaptive Bitrate Streaming for Mobile Cloud Gaming Jan 2021 – May 2024
[HKUST, Hong Kong]: Design and develop a full video streaming pipeline for cloud gaming
Adapt video rate to underlying network conditions
Fair evaluation against SOTA solutions.
WebRTCReinforcement LearningAdaptive Streaming
Human-Avatar Interaction in Metaverse Apr 2022 – 2024
[HKUST, Hong Kong]: Real-time multimedia communication and full-body human-avatar interaction framework
Enabling technologies: Virtual Reality, Augmented Reality, Unity, Mocap Sensors
Unity3DXRAvatars PERCEPTION NEURON 3
Edge-assisted Driving Awareness on The Roads Sep 2019 – Jan 2021
[HKUST, Hong Kong]: Framework for real-time vehicle data streaming and processing (Apache Kafka and Spark)
Framework for detecting unsafe driving activities at network edge (RSUs)
Evaluate reliability and responsiveness.
Apache KafkaSparkEdge ComputingRSU
Service & tools to support ML Development Life Cycle 2021 – 2022
[LSCM, Hong Kong]: Research project focusing on MLOps pipelines, reproducibility and deployment at the edge.
MLOpsDockerKubernetes
Distributed Rendering in Cloud Gaming 2020 – 2021
[Huawei, Hong Kong]: Research on splitting rendering workload between edge and cloud to reduce latency for interactive cloud gaming.
Distributed SystemsCloud Rendering
✅ Industry collaborations
Industry Collaboration: Logistics & Supply Chain MultiTech R&D Centre (Hong Kong) Completed
Technologies: Python, git, Docker, Kubernetes.
Industry Collaboration: Huawei Technologies (Shenzhen, China) Completed
Technologies: Unity3D, C#, video codec.