Home About the Journal Latest Work Current Issue Archive Special Issues Editorial Board
<< Previous

2019, 1(6): 622-634

Published Date:2019-12-20 DOI: 10.1016/j.vrih.2019.09.006

Research on the visual elements of augmented reality assembly processes


To solve the problem of visualization in augmented reality (AR), for assembly process information, we report here on our study into the composition of AR assembly process information.
Our work led us to classify the visual elements of assembly processes into six categories, and after looking further into visual element expression characteristics used in assembly process information in the AR environment, standard assembly process elements have been identified and visual element layout principles studied.
Typical visualization elements have been presented, using an AR-based assembly instruction system.


Augmented reality ; Visual element ; Process information ; Assembly guidance

Cite this article

Wang LI, Junfeng WANG, Sichen JIAO, Meng WANG, Shiqi LI. Research on the visual elements of augmented reality assembly processes. Virtual Reality & Intelligent Hardware, 2019, 1(6): 622-634 DOI:10.1016/j.vrih.2019.09.006


1. Webel S, Bockholt U, Engelke T, Gavish N, Olbrich M, Preusche C. An augmented reality training platform for assembly and maintenance skills. Robotics and Autonomous Systems, 2013, 61(4): 398–403 DOI:10.1016/j.robot.2012.09.013

2. Dini G, Mura M D. Application of augmented reality techniques in through-life engineering services. Procedia CIRP, 2015, 38: 14–23 DOI:10.1016/j.procir.2015.07.044

3. Wang X, Ong S K, Nee A Y C. Multi-modal augmented-reality assembly guidance based on bare-hand interface. Advanced Engineering Informatics, 2016, 30(3): 406–421 DOI:10.1016/j.aei.2016.05.004

4. Mohr P, Kerbl B, Donoser M, Schmalstieg D, Kalkofen D. Retargeting technical documentation to augmented reality. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. Seoul, Republic of Korea, ACM Press, 2015DOI:10.1145/2702123.2702490

5. Chen C J, Hong J, Wang S F. Automated positioning of 3D virtual scene in AR-based assembly and disassembly guiding system. The International Journal of Advanced Manufacturing Technology, 2015, 76(5/6/7/8): 753–764 DOI:10.1007/s00170-014-6321-6

6. Bottani E, Vignali G. Augmented reality technology in the manufacturing industry: A review of the last decade. IISE Transactions, 2019, 51(3): 284–310 DOI:10.1080/24725854.2018.1493244

7. Bhattacharya B, Winer E H. Augmented reality via expert demonstration authoring (AREDA). Computers in Industry, 2019, 105: 61–79 DOI:10.1016/j.compind.2018.04.021

8. Mayer R E, Bove W, Bryman A, Mars R, Tapangco L. When less is more: Meaningful learning from visual and verbal summaries of science textbook lessons. Journal of Educational Psychology, 1996, 88(1): 64–73 DOI:10.1037//0022-0663.88.1.64

9. Bruno F, Caruso F, De Napoli L, Muzzupappa M. Visualization of industrial engineering data in Augmented Reality. Journal of Visualization, 2006, 9(3): 319–329 DOI:10.1007/bf03181679

10. Julier S, Lanzagorta M, Baillot Y, Rosenblum L, Feiner S, Hollerer T, Sestito S. Information filtering for mobile augmented reality. In: Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000), Munich, Germany, IEEE, 2000DOI:10.1109/isar.2000.880917

11. Rolim C, Schmalstieg D, Kalkofen D, Teichrieb V. Design guidelines for generating augmented reality instructions. In: 2015 IEEE International Symposium on Mixed and Augmented Reality. Fukuoka, Japan, IEEE, 2015DOI:10.1109/ismar.2015.36

12. Haringer M, Regenbrecht H T. A pragmatic approach to augmented reality authoring. In: Proceedings. International Symposium on Mixed and Augmented Reality. Darmstadt, Germany, IEEE Computer Society, 2002, 237–245 DOI:10.1109/ismar.2002.1115093

13. Zauner J, Haller M, Brandl A, Hartman W. Authoring of a mixed reality assembly instructor for hierarchical structures. In: The Second IEEE and ACM International Symposium on Mixed and Augmented Reality. Tokyo, Japan, IEEE Computer Society, 2003, 237–246 DOI:10.1109/ismar.2003.1240707

14. Radkowski R, Herrema J, Oliver J. Augmented reality-based manual assembly support with visual features for different degrees of difficulty. International Journal of Human-Computer Interaction, 2015, 31(5): 337–349 DOI:10.1080/10447318.2014.994194

15. Keil J, Schmitt F, Engelke T, Graf H, Olbrich M. Augmented reality views: discussing the utility of visual elements by mediation means in industrial AR from a design perspective. In: Virtual, Augmented and Mixed Reality: Applications in Health, Cultural Heritage, and Industry. Springer International Publishing, 2018, 298–312 DOI:10.1007/978-3-319-91584-5_24

16. Gattullo M, Scurati G W, Fiorentino M, Uva A E, Ferrise F, Bordegoni M. Towards augmented reality manuals for industry 4.0: A methodology. Robotics and Computer-Integrated Manufacturing, 2019, 56: 276–286 DOI:10.1016/j.rcim.2018.10.001

17. Langlotz T, Mooslechner S, Zollmann S, Degendorfer C, Reitmayr G, Schmalstieg D. Sketching up the world: in situ authoring for mobile Augmented Reality. Personal and Ubiquitous Computing, 2012, 16(6): 623–630 DOI:10.1007/s00779-011-0430-0

18. Zhu J, Ong S K, Nee A Y C. A context-aware augmented reality assisted maintenance system. International Journal of Computer Integrated Manufacturing, 2015, 28(2): 213–225 DOI:10.1080/0951192x.2013.874589

19. Ramirez H, Mendivil E G, Flores P R, Gonzalez M C. Authoring software for augmented reality applications for the use of maintenance and training process. Procedia Computer Science, 2013, 25: 189–193 DOI:10.1016/j.procs.2013.11.023

20. Palmarini R, Erkoyuncu J A, Roy R, Torabmostaedi H. A systematic review of augmented reality applications in maintenance. Robotics and Computer-Integrated Manufacturing, 2018, 49: 215–228 DOI:10.1016/j.rcim.2017.06.002

21. Jee H K, Lim S, Youn J, Lee J. An augmented reality-based authoring tool for E-learning applications. Multimedia Tools and Applications, 2014, 68(2): 225–235 DOI:10.1007/s11042-011-0880-4


1. Kangkang YANG, Yu GUO, Pengzhou TANG, Haopeng ZHANG, Han LI, Object registration using an RGB-D camera for complex product augmented assembly guidance Virtual Reality & Intelligent Hardware 2020, 2(6): 501-517

2. Mengting XIAO, Zhiquan FENG, Xiaohui YANG, Tao XU, Qingbei GUO, Multimodal interaction design and application in augmented reality for chemical experiment Virtual Reality & Intelligent Hardware 2020, 2(4): 291-304

3. Yonghang TAI, Junsheng SHI, Junjun PAN, Aimin HAO, Victor CHANG, Augmented reality-based visual-haptic modeling for thoracoscopic surgery training systems Virtual Reality & Intelligent Hardware 2021, 3(4): 274-286

4. Mingxuan CHEN, Ping ZHANG, Zebo WU, Xiaodan CHEN, A multichannel human-swarm robot interaction system in augmented reality Virtual Reality & Intelligent Hardware 2020, 2(6): 518-533

5. Yukang YAN, Xin YI, Chun YU, Yuanchun SHI, Gesture-based target acquisition in virtual and augmented reality Virtual Reality & Intelligent Hardware 2019, 1(3): 276-289

6. Yuan GAO, Le XIE, A review on the application of augmented reality in craniomaxillofacial surgery Virtual Reality & Intelligent Hardware 2019, 1(1): 113-120

7. Jinyu LI, Bangbang YANG, Danpeng CHEN, Nan WANG, Guofeng ZHANG, Hujun BAO, Survey and evaluation of monocular visual-inertial SLAM algorithms for augmented reality Virtual Reality & Intelligent Hardware 2019, 1(4): 386-410

8. Xiaomei ZHAO, Fulin TANG, Yihong WU, Real-time human segmentation by BowtieNet and a SLAM-based human AR system Virtual Reality & Intelligent Hardware 2019, 1(5): 511-524

9. Chan QIU, Shien ZHOU, Zhenyu LIU, Qi GAO, Jianrong TAN, Digital assembly technology based on augmented reality and digital twins: a review Virtual Reality & Intelligent Hardware 2019, 1(6): 597-610

10. Pengfei HAN, Gang ZHAO, A review of edge-based 3D tracking of rigid objects Virtual Reality & Intelligent Hardware 2019, 1(6): 580-596

11. Shenze WANG, Kaikai DU, Ningfang SONG, Dongfeng ZHAO, Di FENG, Zhengqian TU, Study on the adaptability of augmented reality smartglasses for astigmatism based on holographic waveguide grating Virtual Reality & Intelligent Hardware 2020, 2(1): 79-85

12. Xiang ZHOU, Liyu TANG, Ding LIN, Wei HAN, Virtual & augmented reality for biological microscope in experiment education Virtual Reality & Intelligent Hardware 2020, 2(4): 316-329

13. Lingfei ZHU, Qi CAO, Yiyu CAI, Development of augmented reality serious games with a vibrotactile feedback jacket Virtual Reality & Intelligent Hardware 2020, 2(5): 454-470

14. Yun-Han LEE, Tao ZHAN, Shin-Tson WU, Prospects and challenges in augmented reality displays Virtual Reality & Intelligent Hardware 2019, 1(1): 10-20

15. Zike YAN, Hongbin ZHA, Flow-based SLAM: From geometry computation to learning Virtual Reality & Intelligent Hardware 2019, 1(5): 435-460