Special Issues

Simulation and interaction of fluid and solid dynamics

Intro：Fluid and solid simulation is to generate a realistic simulation of fluids and solids, in particular for the fluids such as water and smoke, with computation of Euler equations or Navier-Stokes equations conducted to govern the real fluid physics. Fluid simulation is an important field by its wide applications in many fields and industries, such as film and game simulation, weather forecasting, natural disaster simulation and protection, simulation in maritime and aviation. There are basically two main categories of methods for fluid simulation, data-driven methods and physically-based methods. The data-driven models establish a direct mapping between variables and extract their relationship from historically measured data by the algorithms developed in the fields of statistics, computational intelligence, machine learning, and data mining. The physically-based models mainly express interior behavior through solving some mathematical equations that represent the motion of objects. The complicated interaction of fluid and solid is also an important topic in fluid simulation. Fluid-solid interaction happens in various forms in our lives. We have selected in this special issue seven papers that provide the latest updates on the development of Data-driven simulation in fluids animation, and various physically based approaches such as the smoothed particle hydrodynamics (SPH), two-phase liquid simulation, cumulus cloud modeling.

2021 Vol. 3 No. 2

Browse： 75

查看详情

Emotion recognition for human-computer interaction

Intro：Emotion recognition is to quantify,describe and recognize different emotional states through thebehavioral and physiological responses generated from emotional expressions.Emotion recognition is animportant field due to its wide applications in many tasks,such as dialogue generation,social mediaanalysis and intelligent system.It builds a harmonious human-computer environment by enabling thecomputer systems and devices to recognize and interpret human affects.Emotion recognition models arebuilt using multimodal information such as audio,video,text and so on.It is important to consider emotioncharacteristics of humans in the design and presentation of intelligent interaction.We have selected sevenpapers that provide the latest updates on the development of emotion recognition technology coveringmicro-expression spotting and recognition,speech emotion recognition,physiological signal emotionrecognition,emotional dialog generation and so on.

2021 Vol. 3 No. 1

Browse： 229

查看详情

VR/AR research and commercial applications in Singapore

Intro：The COVID-19 pandemic has virtually changed every aspect of our lives and society globally. This special issue is developed during this challenging time. Going through the period of circuit breaker, Singapore is now planning ahead for the post pandemic era. One of the strategic areas is to embrace innovative technologies including virtual reality (VR) and augmented reality (AR) for work, study, and life in the new normal.

2020 Vol. 2 No. 5

Browse： 232

查看详情

VR and experiment simulation

Intro：In this special issue,the theme is on the application of VR/AR to experiments and training.We include7papers which can be divided into two sets,one on specific virtual experiments covering chemistry andbiology,the other on the supporting techniques for VR experiments.

2020 Vol. 2 No. 4

Browse： 229

查看详情

3D Visual Processing and Reconstruction

Intro：3D sensing represents the main channel through which humans, or robotics agents, understand and interact with each other and with the real world. As such, many 3D acquisition technologies and devices have been developed and applied in emerging applications, such as autonomous systems, augmented reality and digital production. A typical 3D visual system takes RGB and/or range images of an object or scene and generates 3D geometry. There are several classic solutions for different settings, for example, structure from motion (SfM) for scattered images, Simultaneous Localization and Mapping (SLAM) for structured images along temporal axis. A research trend has been introducing deep learning into many conventional operations, such as pose estimation, spatial computation, and scene recognition. Besides 3D geometry, modeling of texture, material and lighting properties are also part of 3D visual processing.

2020 Vol. 2 No. 3

Browse： 987

查看详情

Visual Interaction and its applications

Intro：Visual interaction is a kind of technology that defines mechanisms, through which the users can perform actions on the interactive system by means of visual elements, and the system can provide feedback to the user, by visually representing the results of the computations triggered by the user actions. It continues to be both a hot academic topic in computer science, and a key factor in industrial, medical, entertainment and office applications, etc. To achieve a more natural communication with human in a virtual environment (VE), we require to detect or recognize human face, emotion, gesture, eye gaze, etc., and to efficiently render high quality images, so that people can interact through natural interfaces and receive prompt and realistic visual feedbacks. Researchers attempt to create natural user interface (NUI) for human-computer interaction that the user operates through intuitive actions related to natural, everyday human behavior. Thus, most research focuses on traditional human abilities, such as vision, touch, motion, as well as cognition and even expert skills to replicate real world environments to optimize interaction between physical and digital objects. In this special issue, we have selected 7 papers (research articles) covering 3 most relevant visual interaction techniques for the VE applications, including facial expression and gesture recognition, real time rendering, 3D manipulation.

2020 Vol. 2 No. 2

Browse： 950

查看详情

VR/AR in industry

Intro：Virtual reality/augmented reality (VR/AR) has been widely used in the industrial fields, such as product design, manufacturing, assembly, maintenance, performance evaluation and other life cycle stages. The technical characteristics of VR can be summarized as virtual world, immersion, sensory feedback, and interactivity. The virtual world or virtual environment (VE) is a mapping of the real world. By reproducing the real environment, the operator can interact with the virtual world truly. For the research and application in the industrial fields, the modeling and simulation of the virtual world reflecting the physical nature are particularly important. The connection of virtual reality and real reality can be reflected in the expansion of two aspects from an industrial point of view: AR and digital twin (DT). On the one hand, AR technology reduces the workload of 3D modeling by integrating the virtual environment with the real world, and improves the credibility of the virtual environment and the experience of the operator. In particular, the term "augmented reality (AR)" was first proposed by Boeing in the early 1990s when they used the AR technology in auxiliary wiring systems. On the other hand, DT, one of the core technologies of the new generation of intelligent manufacturing, realizes the sharing of digital information through the mapping of the real and virtual worlds. In this special issue, we have selected 6 papers (4 review papers and 2 research papers) covering the most relevant technologies and fields in VR/AR/ DT applications, including cable layout design, digital human technology, target tracking, assembly guidance and virtual-real mapping manufacturing.

2019 Vol. 1 No. 6

Browse： 1150

查看详情

3D Vision

Intro：3D vision is a kind of technology that allow computers to perceive, reconstruct and interact with the 3D world based on vision sensors. It is not only a hot academic topic in computer science, but also crucial to many applications, such as virtual reality (VR) and augmented reality (AR). For achieving high-quality effects of VR and AR, we need to recover the 6DoF camera pose, 3D structure of the scene, and even the human interaction, so that people not only can see the lifelike virtual objects/scenes, but also the seamless fusion of virtual and real contents and even interact with them. We can leverage 3D vision technology to achieve this objective. For example, the simultaneous localization and mapping (SLAM) technique allows users to walk freely in a digital world wearing a VR/AR helmet by recovering the 6DoF movement of the helmet, and is also able to see the seamless mixture of real and virtual contents, and even the effect of their interaction with each other by reconstructing the geometry, textures and materials of the real environment. In this special issue, we have selected 6 papers (3 review papers, 2 research articles and 1 case report) covering 3 most relevant 3D vision techniques for the VR/AR applications, including SLAM, 3D reconstruction, object segmentation and tracking.

2019 Vol. 1 No. 5

Browse： 1252

查看详情

Human-computer Interaction

Intro：Human-computer interactions constitute an important subject for the development and popularization of information technologies, as they are not only an important frontier technology in computer science but also an important auxiliary technology in virtual reality (VR). In recent years, Chinese researchers have made significant advances in human-computer interactions. To systematically display China's latest advances in human-computer interactions and thus provide an impetus for the development of VR and other related fields, we have solicited articles for this special issue from experts in this area to participate in the review process. The following articles have been selected for publication in this special issue.

2019 Vol. 1 No. 3

Browse： 1554

查看详情

Haptic Interaction

Intro：Touch is an important channel for human beings to communicate with the external world and plays a crucial role in human interaction with nature. Information such as softness, friction, texture and warmth, or more complicated human emotional communication can only be perceived by the act of touching. Despite its importance, it is striking that haptic feeback in human-machine interaction is still in its infancy. For example, a human user can enjoy realistic visual or auditory experiences facilitated by a computer through devices such as a head-mounted display or a stereo headset. However, haptic experiences that the user can obtain is extremely limited during such interactions. Haptic interaction technology enables users to touch virtual objects and experience tactile sensations, including contact force, softness, texture, weight, vibration, and temperature. These sensations can significantly enhance users' interactive experience of virtual-reality systems. Haptic interaction technology can be applied in many fields, such as surgical simulation/ training, virtual assembly and maintenance of complex mechanical equipment such as aircraft engines, interactive entertainment experiences such as movies and computer games.

2019 Vol. 1 No. 2

Browse： 1817

查看详情