科研之友
微信
新浪微博
Facebook
分享链接
摘要
Mobile internet real-time rendering technology facilitates key technical capabilities on the aspects of three dimensions (3D) visualization, computer vision, virtual reality, augmented reality, extended reality, and meta-universe. 3D visualization applications based on online real-time rendering technology have been widely scattered on multiple mobile Internet platforms. 3D based Internet applications have been transformed into new online visualization applications with 3D virtual scenes as the main interactive object and intensive immersion to deal with service locations and time constrained issues of the mobile Internet. Our review is focused on four platforms, including mobile terminals, web terminals, cloud terminals and multi-terminals collaboration. First, we investigate the "graphics processing unit" on mobile devices, which is the critical factor of mobile online real-time graphics rendering, and analyze its recent computing ability, designing, and optimization issues. We examined the possibility of hosting desktop-level rendering algorithms on mobile rendering devices, taking the ray-tracing approach as an example. We analyzed the rendering algorithms issues can be accelerated on the power and bandwidth constrained mobile orientation. We reviewed mobile rendering tools like mobile graphics application programming interface(API) and game engines, and conduct comparative category analysis for their performance. Second, we discussed the current Web3D online rendering mechanisms represented by the combination of WebGL2.0 and HTML5 in terms of web-oriented online real-time graphics rendering; we compared the technical features and rendering performance of well-known Web3D engines, and review the support of mainstream game engines for Web3D applications; we examined the challenged technologies of Web3D lightweighting solutions in related to the online real-time rendering of large-scale Web3D scenes like Web3D scene lightweighting and peer-to-peer networking(P2P) progressive transmission. In respect of online real-time graphics cloud rendering, we analyzed the remote rendering architecture of cloud rendering system; We revealed the core service layer of cloud rendering system in terms of cloud services-"platform as a service (PaaS)", and sorted its three major functions out like application hosting, resource scheduling, and streaming; we analyzed two types of cloud-rendering optimization strategies derived from video stream compression and rendering latency mitigation; we described the core application of online cloud rendering system-the "cloud game", and compared the system framework, technical features, and user experience of some of the latest "cloud game" applications. To enable multi-end collaborative online graphics rendering, we analyzed the rendering-task sharing and collaboration of the end-cloud system; we examined the collaboration pattern and technical features of the end-edge-cloud rendering system based on the introduction of edge computing; we make use of rendering resources toanalyze the load balancing optimization issues originated from computing power deployment and resource scheduling of the multi-end rendering system. Finally, we listed the current industry based online real-time cloud rendering systems, including NVIDIA-derived CloudXR, unity-based render streaming, Microsoft Azure remote rendering, and Kujiale cloud-based home decoration and design platform. We compared these systems through their framework, technical features and rendering effects.
- 单位
