Home About the Journal Latest Work Current Issue Archive Special Issues Editorial Board
<< Previous Next >>

2020, 2(4): 316-329

Published Date:2020-8-20 DOI: 10.1016/j.vrih.2020.07.004

Virtual & augmented reality for biological microscope in experiment education

Abstract

Background
Mixed-reality technologies, including virtual reality (VR) and augmented reality (AR) , are considered to be promising potential tools for science teaching and learning processes that could foster positive emotions, motivate autonomous learning, and improve learning outcomes.
Methods
In this study, a technology-aided biological microscope learning system based on VR/AR is presented. The structure of the microscope is described in a detailed three-dimensional (3D) model, each component being represented with their topological interrelationships and associations among them being established. The interactive behavior of the model was specified, and a standard operating guide was compiled. The motion control of components was simulated based on collision detection. Combined with immersive VR equipment and AR technology, we developed a virtual microscope subsystem and a mobile virtual microscope guidance system.
Results
The system consisted of a VR subsystem and an AR subsystem. The focus of the VR subsystem was to simulate operating the microscope and associated interactive behaviors that allowed users to observe and operate the components of the 3D microscope model by means of natural interactions in an immersive scenario. The AR subsystem allowed participants to use a mobile terminal that took a picture of a microscope from a textbook and then displayed the structure and functions of the instrument, as well as the relevant operating guidance. This flexibly allowed students to use the system before or after class without time and space constraints. The system allowed users to switch between the VR and AR subsystems.
Conclusions
The system is useful for helping learners (especially K-12 students) to recognize a microscope's structure and grasp the required operational skills by simulating operations using an interactive process. In the future, such technology-assisted education would be a successful learning platform in an open learning space.

Keyword

Virtual reality ; Augmented reality ; Microscope ; Operating guide ; Experiment

Cite this article

Xiang ZHOU, Liyu TANG, Ding LIN, Wei HAN. Virtual & augmented reality for biological microscope in experiment education. Virtual Reality & Intelligent Hardware, 2020, 2(4): 316-329 DOI:10.1016/j.vrih.2020.07.004

References

1. Sigitov A, Hinkenjann A, Roth T. Towards VR-based systems for school experiments. Procedia Computer Science, 2013, 25: 201–210 DOI:10.1016/j.procs.2013.11.025

2. Ardiny H, Khanmirza E. The role of AR and VR technologies in education developments: opportunities and challenges. In: 2018 6th RSI International Conference on Robotics and Mechatronics (IcRoM). Tehran, Iran, IEEE, 2018, 482–487 DOI:10.1109/icrom.2018.8657615

3. Stull A T, Gainer M J, Hegarty M. Learning by enacting: the role of embodiment in chemistry education. Learning and Instruction, 2018, 55: 80–92 DOI:10.1016/j.learninstruc.2017.09.008

4. Harley J M, Lajoie S P, Tressel T, Jarrell A. Fostering positive emotions and history knowledge with location-based augmented reality and tour-guide prompts. Learning and Instruction, 2018, 101163 DOI:10.1016/j.learninstruc.2018.09.001

5. Yip J, Wong S H, Yick K L, Chan K, Wong K H. Improving quality of teaching and learning in classes by using augmented reality video. Computers & Education, 2019, 128: 88–101 DOI:10.1016/j.compedu.2018.09.014

6. Chang S C, Hwang G J. Impacts of an augmented reality-based flipped learning guiding approach on students' scientific project performance and perceptions. Computers & Education, 2018, 125: 226–239 DOI:10.1016/j.compedu.2018.06.007

7. Kartiko I, Kavakli M, Cheng K. Learning science in a virtual reality application: the impacts of animated-virtual actors' visual complexity. Computers & Education, 2010, 55(2): 881–891 DOI:10.1016/j.compedu.2010.03.019

8. Mannuß F, Rubel J, Wagner C, Bingel F, Hinkenjann A. Augmenting magnetic field lines for school experiments. In: 2011 10th IEEE International Symposium on Mixed and Augmented Reality. Basel, Switzerland, IEEE, 2011, 263–264 DOI:10.1109/ismar.2011.6143893

9. Liu Q T, Xu S X, Yu S F, Yang Y Y, Wu L J, Ba S. Design and implementation of an AR-based inquiry courseware: magnetic field. In: 2019 International Symposium on Educational Technology (ISET). Hradec Kralove, Czech Republic, IEEE, 2019, 134–138 DOI:10.1109/iset.2019.00036

10. Chang R C, Yu Z S. Using augmented reality technologies to enhance students' engagement and achievement in science laboratories. International Journal of Distance Education Technologies, 2018, 16(4): 54–72 DOI:10.4018/ijdet.2018100104

11. Burden K, Kearney M. Future scenarios for mobile science learning. Research in Science Education, 2016, 46(2): 287–308 DOI:10.1007/s11165-016-9514-1

12. Yang S X, Mei B, Yue X Y. Mobile augmented reality assisted chemical education: insights from elements 4D. Journal of Chemical Education, 2018, 95(6): 1060–1062 DOI:10.1021/acs.jchemed.8b00017

13. Leahy S M, Holland C, Ward F. The digital frontier: envisioning future technologies impact on the classroom. Futures, 2019, 113: 102422 DOI:10.1016/j.futures.2019.04.009

14. Cheng K H, Tsai C C. Affordances of augmented reality in science learning: suggestions for future research. Journal of Science Education and Technology, 2013, 22(4): 449–462 DOI:10.1007/s10956-012-9405-9

15. Brett E S, Reed R S. Using coordination classes to interpret conceptual change in astronomical thinking. In the International Conference on Learning Sciences, 2004, 4: 634 DOI:10.1145/2858036.2858589

16. Andujar J M, Mejias A, Marquez M A. Augmented reality for the improvement of remote laboratories: an augmented remote laboratory. IEEE Transactions on Education, 2011, 54(3): 492–500 DOI:10.1109/te.2010.2085047

17. Cai S, Wang X, Chiang F K. A case study of Augmented Reality simulation system application in a chemistry course. Computers in Human Behavior, 2014, 37: 31–40 DOI:10.1016/j.chb.2014.04.018

18. Abu Bakar J A, Gopalan V, Zulkifli A N, Alwi A. Design and development of mobile augmented reality for physics experiment. In: Communications in Computer and Information Science. Singapore, Springer Singapore, 2018, 47–58 DOI:10.1007/978-981-13-1628-9_5

19. McGrath D, Wegener M, McIntyre T J, Savage C, Williamson M. Student experiences of virtual reality: a case study in learning special relativity. American Journal of Physics, 2010, 78(8): 862–868 DOI:10.1119/1.3431565

20. Ding N, Wang Y. Application of virtual reality in education: advantages and challenges. Modern Educational Technology, 2017, 27(2): 20–26 DOI:10.3969/j.issn.1009-8097.2017.02.003

21. Wolski R, Jagodziński P. Virtual laboratory: using a hand movement recognition system to improve the quality of chemical education. British Journal of Educational Technology, 2019, 50(1): 218–231 DOI:10.1111/bjet.12563

22. Abreu P A, Carvalho K d L, RabeloV W H, Castro H C. Computational strategy for visualizing structures and teaching biochemistry. Biochemistry and Molecular Biology Education, 2019, 47(1):76–84 DOI:10.1002/bmb.21199

23. Rui M A, Dong L Y, Chen X D, Wang J Z. Microscopic control system for biological experiment teaching based on 3D simulation technology. Computer Technology and Development, 2011, 21(6): 208–211 DOI:10.3969/j.issn.1673-629X.2011.06.055

24. Chang J W, Wang W P, Kim M S. Efficient collision detection using a dual OBB-sphere bounding volume hierarchy. Computer-Aided Design, 2010, 42(1): 50–57 DOI:10.1016/j.cad.2009.04.010

Related

1. Hengwei XU, Siru LI, Wenpeng SONG, Jiajun SUN, Xinli WU, Xiaoqi WANG, Wenzhen YANG, Zhigeng PAN, Abdennour EI RHALIBI, Thermal perception method of virtual chemistry experiments Virtual Reality & Intelligent Hardware 2020, 2(4): 305-315

2. Yukang YAN, Xin YI, Chun YU, Yuanchun SHI, Gesture-based target acquisition in virtual and augmented reality Virtual Reality & Intelligent Hardware 2019, 1(3): 276-289

3. Yuan GAO, Le XIE, A review on the application of augmented reality in craniomaxillofacial surgery Virtual Reality & Intelligent Hardware 2019, 1(1): 113-120

4. Meng SONG, Shiyi LIU, Ge YU, Lili GUO, Dangxiao WANG, An immersive space liquid bridge experiment system with gesture interaction and vibrotactile feedback Virtual Reality & Intelligent Hardware 2019, 1(2): 219-232

5. Mengting XIAO, Zhiquan FENG, Xiaohui YANG, Tao XU, Qingbei GUO, Multimodal interaction design and application in augmented reality for chemical experiment Virtual Reality & Intelligent Hardware 2020, 2(4): 291-304

6. Rui HAN, Zhiquan FENG, Jinglan TIAN, Xue FAN, Xiaohui YANG, Qingbei GUO, An intelligent navigation experimental system based on multi-mode fusion Virtual Reality & Intelligent Hardware 2020, 2(4): 345-353

7. Yuxiang ZHAO, Xiaowei AN, Nongliang SUN, Virtual simulation experiment of the design and manufacture of a beer bottle-defect detection system Virtual Reality & Intelligent Hardware 2020, 2(4): 354-367

8. Yonghang TAI, Junsheng SHI, Junjun PAN, Aimin HAO, Victor CHANG, Augmented reality-based visual-haptic modeling for thoracoscopic surgery training systems Virtual Reality & Intelligent Hardware 2021, 3(4): 274-286

9. Mingxuan CHEN, Ping ZHANG, Zebo WU, Xiaodan CHEN, A multichannel human-swarm robot interaction system in augmented reality Virtual Reality & Intelligent Hardware 2020, 2(6): 518-533

10. Jinyu LI, Bangbang YANG, Danpeng CHEN, Nan WANG, Guofeng ZHANG, Hujun BAO, Survey and evaluation of monocular visual-inertial SLAM algorithms for augmented reality Virtual Reality & Intelligent Hardware 2019, 1(4): 386-410

11. Xiaomei ZHAO, Fulin TANG, Yihong WU, Real-time human segmentation by BowtieNet and a SLAM-based human AR system Virtual Reality & Intelligent Hardware 2019, 1(5): 511-524

12. Chan QIU, Shien ZHOU, Zhenyu LIU, Qi GAO, Jianrong TAN, Digital assembly technology based on augmented reality and digital twins: a review Virtual Reality & Intelligent Hardware 2019, 1(6): 597-610

13. Wang LI, Junfeng WANG, Sichen JIAO, Meng WANG, Shiqi LI, Research on the visual elements of augmented reality assembly processes Virtual Reality & Intelligent Hardware 2019, 1(6): 622-634

14. Pengfei HAN, Gang ZHAO, A review of edge-based 3D tracking of rigid objects Virtual Reality & Intelligent Hardware 2019, 1(6): 580-596

15. Shenze WANG, Kaikai DU, Ningfang SONG, Dongfeng ZHAO, Di FENG, Zhengqian TU, Study on the adaptability of augmented reality smartglasses for astigmatism based on holographic waveguide grating Virtual Reality & Intelligent Hardware 2020, 2(1): 79-85

16. Lingfei ZHU, Qi CAO, Yiyu CAI, Development of augmented reality serious games with a vibrotactile feedback jacket Virtual Reality & Intelligent Hardware 2020, 2(5): 454-470

17. Yang LI, Dong WU, Jin HUANG, Feng TIAN, Hong'an WANG, Guozhong DAI, Influence of multi-modality on moving target selection in virtual reality Virtual Reality & Intelligent Hardware 2019, 1(3): 303-315

18. Yang LI, Jin HUANG, Feng TIAN, Hong-An WANG, Guo-Zhong DAI, Gesture interaction in virtual reality Virtual Reality & Intelligent Hardware 2019, 1(1): 84-112

19. Athirah SYAMIMI, Yiwei GONG, Ryan LIEW, VR industrial applicationsA singapore perspective Virtual Reality & Intelligent Hardware 2020, 2(5): 409-420

20. Yun-Han LEE, Tao ZHAN, Shin-Tson WU, Prospects and challenges in augmented reality displays Virtual Reality & Intelligent Hardware 2019, 1(1): 10-20

21. Zike YAN, Hongbin ZHA, Flow-based SLAM: From geometry computation to learning Virtual Reality & Intelligent Hardware 2019, 1(5): 435-460

22. Susu HUANG, Daqing QI, Jiabin YUAN, Huawei TU, Review of studies on target acquisition in virtual reality based on the crossing paradigm Virtual Reality & Intelligent Hardware 2019, 1(3): 251-264

23. Yuan CHANG, Guo-Ping WANG, A review on image-based rendering Virtual Reality & Intelligent Hardware 2019, 1(1): 39-54

24. Shiguang QIU, Shuntao LIU, Deshuai KONG, Qichang HE, Three-dimensional virtual-real mapping of aircraft autom-atic spray operation and online simulation monitoring Virtual Reality & Intelligent Hardware 2019, 1(6): 611-621

25. Xu PENG, Zhenyu GAO, Yitong DING, Dongfeng ZHAO, Xiaoyu CHI, Study of ghost image suppression in polarized catadioptric virtual reality optical systems Virtual Reality & Intelligent Hardware 2020, 2(1): 70-78

26. Zhiming HU, Sheng LI, Meng GAI, Temporal continuity of visual attention for future gaze prediction in immersive virtual reality Virtual Reality & Intelligent Hardware 2020, 2(2): 142-152

27. TJ MATTHEWS, Feng TIAN, Tom DOLBY, Interaction design for paediatric emergency VR training Virtual Reality & Intelligent Hardware 2020, 2(4): 330-344

28. Hongxin ZHANG, Jin ZHANG, Xue YIN, Kan ZHOU, Zhigeng PAN, Abdennour EI RHALIBI, Cloud-to-end rendering and storage management for virtual reality in experimental education Virtual Reality & Intelligent Hardware 2020, 2(4): 368-380

29. Haoyu WANG, Jianhuang WU, A virtual reality based surgical skills training simulator for catheter ablation with real-time and robust interaction Virtual Reality & Intelligent Hardware 2021, 3(4): 302-314

30. Na ZHANG, Liwen TAN, Fengying LI, Bing HAN, Yifa XU, Development and application of digital assistive teaching system for anatomy Virtual Reality & Intelligent Hardware 2021, 3(4): 315-335

31. Lihui HUANG, Siti Faatihah Binte Mohd TAIB, Ryan Aung BA, Zhe An GOH, Mengshan XU, Virtual reality research and development in NTU Virtual Reality & Intelligent Hardware 2020, 2(5): 394-408

32. Stéphanie PHILIPPE, Alexis D. SOUCHET, Petros LAMERAS, Panagiotis PETRIDIS, Julien CAPORAL, Gildas COLDEBOEUF, Hadrien DUZAN, Multimodal teaching, learning and training in virtual reality: a review and case study Virtual Reality & Intelligent Hardware 2020, 2(5): 421-442

33. Jia Ming LEE, Xinxing XIA, Clemen OW, Felix CHUA, Yunqing GUAN, VEGO: A novel design towards customizable and adjustable head-mounted display for VR Virtual Reality & Intelligent Hardware 2020, 2(5): 443-453

34. Jingcheng QIAN, Yancong MA, Zhigeng PAN, Xubo YANG, Effects of Virtual-real fusion on immersion, presence, and learning performance in laboratory education Virtual Reality & Intelligent Hardware 2020, 2(6): 569-584

35. Dangxiao WANG, Yuan GUO, Shiyi LIU, Yuru ZHANG, Weiliang XU, Jing XIAO, Haptic display for virtual reality: progress and challenges Virtual Reality & Intelligent Hardware 2019, 1(2): 136-162

36. Aiguo SONG, Liyue FU, Multi-dimensional force sensor for haptic interaction: a review Virtual Reality & Intelligent Hardware 2019, 1(2): 121-135

37. Wenmin ZHU, Xiumin FAN, Yanxin ZHANG, Applications and research trends of digital human models in the manufacturing industry Virtual Reality & Intelligent Hardware 2019, 1(6): 558-579

38. Mohammad Mahmudul ALAM, S. M. Mahbubur RAHMAN, Affine transformation of virtual 3D object using 2D localization of fingertips Virtual Reality & Intelligent Hardware 2020, 2(6): 534-555

39. Yuan WEI, Dongdong GUAN, Qiuchen WANG, Xiangxian LI, Yulong BIAN, Pu QIN, Yanning XU, Chenglei YANG, Virtual fire drill system supporting co-located collaboration Virtual Reality & Intelligent Hardware 2019, 1(3): 290-302