Chinese
Adv Search
Home | Accepted | Article In Press | Current Issue | Archive | Special Issues | Collections | Featured Articles | Statistics

Accepted

View Abstracts Download Citations

EndNote

Reference Manager

ProCite

BiteTex

RefWorks

Affine transformation of virtual 3D object using 2D localization of fingertips

DOI:10.3724/SP.J.2096-5796.20.00053

Accepted Date:2020-11-01

Abstract (75) | PDF (14)

Background Interactions with virtual 3D objects in the virtual reality (VR) environment using the gesture of fingers captured in a wearable 2D camera have emerging applications in real-life. Method This paper presents an approach of a two-stage convolutional neural network, one for the detection of hand and another for the fingertips. One purpose of VR environments is to transform a virtual 3D object with affine parameters by using the gesture of thumb and index fingers. Results To evaluate the performance of the proposed system, one existing, and another developed egocentric fingertip databases are employed so that learning involves large variations that are common in real-life. Experimental results show that the proposed fingertip detection system outperforms the existing systems in terms of the precision of detection. Conclusion The interaction performance of the proposed system in the VR environment is higher than that of the existing systems in terms of estimation error and correlation between the ground truth and estimated affine parameters.

Survey on lightweighting methods of huge 3D models for online Web3D visualization

DOI:10.3724/SP.J.2096-5796.20.00006

Accepted Date:2020-02-13

Abstract (271) | PDF (28)

Background With the rapid development of Web3D technologies, online Web3D visualization , especially for complex models or scenes, has been a great yet heavy demand. As the serious conflict between Web3D system load and the resource consumption in processing these huge models, the huge 3D model lightweighting methods for online Web3D visualization are reviewed in this paper. Methods Observing the geometry redundance introduced by man-made operations in modeling procedure, several categories of lightweighting related work which aim for reducing the data amount and resource consumption for Web3D visualization are elaborated. Results With comparing perspectives, the characteristics of each method are summarized and within the reviewed methods, the geometric redundance removal which achieves the lightweight goal by detecting and removing the repeated components is an appropriate way for current online Web3D visualization. Meanwhile, the learning algorithm, though not practical at present, is our expected topic. Conclusions Various aspects should be considered in an efficient lightweight method for online Web3D visualization, including characteristics of original data, combination or extended of the existed methods, and even scheduling strategy, cache management, rendering mechanism. Meanwhile, innovation methods, especially the learning algorithm is worth exploring.