English
高级检索
首页 | 最新接受 | 预出版 | 当期目次 | 过刊浏览 | 专刊特辑 | 虚拟专辑 | 特色推荐 | 浏览统计

虚拟现实与智能硬件

虚拟现实与智能硬件

当期目次

2019年 第1卷 第2期 上一期

查看摘要 导出题录

EndNote

Reference Manager

ProCite

BiteTex

RefWorks

社论

Haptic feedback for virtual reality

DOI:10.3724/SP.J.2096-5796.2019.0000

2019, 1(2) : 1-2

PDF (26) | HTML (102)

综述

Multi-dimensional force sensor for haptic interaction: a review

DOI:10.3724/SP.J.2096-5796.2019.0016

2019, 1(2) : 121-135

摘要 (125) | PDF (27) | HTML (84)
Haptic interaction plays an important role in the virtual reality technology, which let a person not only view the 3D virtual environment but also realistically touch the virtual environment. As a key part of haptic interaction, force feedback has become an essential function for the haptic interaction. Therefore, multi-dimensional force sensors are widely used in the fields of virtual reality and augmented reality. In this paper, some conventional multi-dimensional force sensors based on different measurement principles, such as resistive, capacitive, piezoelectric, are briefly introduced. Then the mechanical structures of the elastic body of multi-dimensional force sensors are reviewed. It is obvious that the performance of the multi-dimensional force sensor is mainly dependent upon the mechanical structure of elastic body. Furthermore, the calibration process of the force sensor is analyzed, and problems in calibration are discussed. Interdimensional coupling error is one of the main factors affecting the measurement precision of the multi-dimensional force sensors. Therefore, reducing or even eliminating dimensional coupling error becomes a fundamental requirement in the design of multi-dimensional force sensors, and the decoupling state-of-art of the multi-dimensional force sensors are introduced in this paper. At last, the trends and current challenges of multi-dimensional force sensing technology are proposed.
Haptic display for virtual reality: progress and challenges

DOI:10.3724/SP.J.2096-5796.2019.0008

2019, 1(2) : 136-162

摘要 (129) | PDF (25) | HTML (85)
Immersion, interaction, and imagination are three features of virtual reality (VR). Existing VR systems possess fairly realistic visual and auditory feedbacks, and however, are poor with haptic feedback, by means of which human can perceive the physical world via abundant haptic properties. Haptic display is an interface aiming to enable bilateral signal communications between human and computer, and thus to greatly enhance the immersion and interaction of VR systems. This paper surveys the paradigm shift of haptic display occurred in the past 30 years, which is classified into three stages, including desktop haptics, surface haptics, and wearable haptics. The driving forces, key technologies and typical applications in each stage are critically reviewed. Toward the future high-fidelity VR interaction, research challenges are highlighted concerning handheld haptic device, multimodal haptic device, and high fidelity haptic rendering. In the end, the importance of understanding human haptic perception for designing effective haptic devices is addressed.

论文

Haptic interface using tendon electrical stimulation with consideration of multimodal presentation

DOI:10.3724/SP.J.2096-5796.2019.0011

2019, 1(2) : 163-175

摘要 (156) | PDF (25) | HTML (96)
Background
Our previous studies have shown that electrical stimulation from the skin surface to the tendon region (Tendon Electrical Stimulation: TES) can elicit a force sensation, and adjusting the current parameters can control the amount of the sensation. TES is thought to present a proprioceptive force sensation by stimulating receptors or sensory nerves responsible for recognizing the magnitude of the muscle contraction existing inside the tendon, so it can be a proprioceptive module of a small-size, low-cost force feedback device. But there is also suspect that TES presents only strong, noisy skin sensation. From previous study, it was found that TES has some limitation on varying sensations.
Methods
In this study, in addition to characterizing the proprioceptive sensation induced by TES, we constructed a multimodal presentation system reproducing a situation in which force is applied to the hand was offered, so as to investigate whether TES contributed to the reproduction of haptics cooperating with other modalities, rather than disturbing them. Specifically, we used vibration to present a cutaneous sensation and a visual head mounted display (HMD) system to present simultaneous images. Using this system, we also evaluated the efficacy of TES itself and that of the multimodal system involving TES.
Results
We found that TES, along with visual and vibration stimulation, contributed to the perception of a certain force.
Conclusions
Thus, TES appears to be an effective component of multimodal force sense presentation systems.
Eye-around vibration haptics on VR immersion improvement

DOI:10.3724/SP.J.2096-5796.2018.0014

2019, 1(2) : 176-184

摘要 (146) | PDF (29) | HTML (133)
Due to the inherent shortcomings of the hardware, the immersion of visual interaction between the user and the virtual reality (VR) equipment is greatly reduced. In this paper, effects of eye-around vibration haptics on improving the VR immersion were studied. The vibration was generated by flexible vibrators whose performance was evaluated by a laser vibrometer. Fitting the vibrators on the human eye area at different positions and derived by different waveforms and frequencies of the input signal, the effects of vibration on the human vision and comfort of the users were verified. Then, with the selected input signals and fitting locations, different kinds of vibration were applied on the eye area cooperating with virtual reality images or videos to evaluate the changes of immersion. Research results provide references to the modeling of eye tactile feedback and the design of relevant tactile device in improving the VR immersion.
Psychophysics of wearable haptic/tactile perception in a multisensory context

DOI:10.3724/SP.J.2096-5796.2018.0012

2019, 1(2) : 185-200

摘要 (131) | PDF (37) | HTML (99)
Multisensory lab based in Peking University, has carried out basic studies in multisensory space and time processing, intersensory binding and haptic/tactile perception. We exploited a typical paradigm of multisensory illusion-temporal ventriloquist effect and applied it in a wide range of multisensory interactions (mainly focused on temporal processing). In this work, we summarized how the tactile stimuli were exploited to compose tactile cues and as tactile apparent motion to interface with other sensory stimuli (visual and auditory stimuli) to examine the underlying perceptual organization in a multisensory context. Moreover, we introduced two examples of wearable haptic/tactile perception in our lab, by using two customized tactile devices and discussed the potential applications in this field.

综述

多媒体(移动)终端静电力触觉再现

DOI:10.3724/SP.J.2096-5796.2019.0003

2019, 1(2) : 201-218

摘要 (130) | PDF (23) | HTML (148)
静电力触觉再现技术可以通过裸指感知触摸屏中视觉对象的形状、纹理等触觉特征,提升人机交互的真实性和沉浸感。本文着眼于静电力触觉再现技术在平板显示器上的应用,从静电力触觉再现的典型装置、触觉渲染模型驱动和数据驱动算法、驱动信号加载方式、触觉再现效果评测方法等几个方面进行综述,通过对文献的整理和分析,对该技术的发展现状和未来前景作出以下判断:(1)静电力触觉再现技术是在多媒体终端表面实现低功耗裸指触觉再现功能的优选方案;(2)静电力触觉再现技术渲染动态范围尚有不足,针对粗糙纹理的呈现效果较佳,但对细腻纹理的呈现效果不理想,多元融合技术可能是解决途径之一;(3)从触觉再现效果评测的角度看,该领域尚有相当大的进步空间,理论模型和应用算法均有很多工作尚未展开;(4)静电力触觉再现技术本质上属于应用科学,理论研究和商业应用的相互促进、良性推动是其进步的必由之路,因此急需一款较为成熟的原理样机在商业上推广应用。

论文

基于手势交互和振动触觉反馈的沉浸式空间液桥实验系统

DOI:10.3724/SP.J.2096-5796.2019.0001

2019, 1(2) : 219-232

摘要 (121) | PDF (20) | HTML (160)
液桥操作是空间站遥科学实验的重要内容,为保证人与远程空间实验设备的同步交互操作需求,对交互操作精确性和实时性有严格要求。针对空间液桥实验中拉桥、清桥等典型操作的随动控制任务,为达到自然沉浸的交互式效果,研制了基于Leap Motion手势交互控制并融合振动触觉反馈的三维沉浸式液桥实验系统。提出了一种基于位置控制的手势识别算法与模糊控制算法,实验验证该算法记忆负荷小,识别准确率为97.68%。实验结果表明视触融合的交互性效果优于单一视觉反馈效果,将Leap Motion多手势识别、振动触觉反馈与三维沉浸显示有机融合,为空间遥科学实验提供了新型的自然交互方式。
面向盲人的触听觉多通道交互设计探索

DOI:10.3724/SP.J.2096-5796.2019.0002

2019, 1(2) : 233-239

摘要 (157) | PDF (39) | HTML (148)
背景 从多通道交互设计的视角,结合目前的盲人辅助设备的设计,研究面向盲人的触听觉多通道的交互设计。
方法
结合经典的多通道假设和认知,以及多通道交互设计,提出面向盲人的触听觉多通道交互模型,概括盲人的交互方式,分析多种感官交互界面蕴含的信息流向,并通过用户实验分析触听觉多通道下盲人用户的认知理解能力。
结果
在触听觉多通道交互情景下,盲人用户的认知体验和认知效率得到显著提升。
结论
根据盲人触听觉多通道交互模型和多通道用户实验,从触听觉认知交互体验的角度,提出盲人辅助设备及其交互设计的原则,指导盲人触听觉辅助设备的设计探索。触听觉多通道交互设计最终让盲人无障碍的享受互联网的丰富信息。
一种文字图像触觉识别方法

DOI:10.3724/SP.J.2096-5796.2018.0013

2019, 1(2) : 240-249

摘要 (122) | PDF (10) | HTML (127)
对于视觉障碍人士而言,欣赏书法作品是可望而不可及的。研发一种文字图像触觉识别方法,可以让盲人触觉感知数字图像中的文字。提出一种基于边缘切向流的高斯差分算法,精细提取出文字的轮廓边界,得到流畅、平滑且保留显著边缘特征的文字轮廓;提出一种基于五要素的触觉生成算法,生成稳定且连续的触觉,感知文字轮廓。实验结果表明盲人经过适应性训练后,通过此技术可以较好地识别出一些轮廓不是很复杂的文字,为触觉欣赏书法作品提供了可能。