Design and implementation of Chinese architecture history teaching system based on mixed reality technology

doi:10.11772/j.issn.1001-9081.2019030545

Abstract

Abstract:

The teaching of Chinese architecture history has building structures too complex, is limited to 2D planar teaching and is not easy for students to master and apply, therefore an implementation method of Chinese architecture history teaching system based on mixed reality technology was proposed. The wooden structure system of Baoguo Temple in Ningbo was taken as an example, and the mixed reality device Microsoft HoloLens was used as the teaching platform. Firstly, 3ds Max was applied to the 3D simulation modeling of the wooden structure system of Baoguo Temple based on the collected data, and a building model library was built. Then, the 3D human-computer interface of the virtual teaching system was constructed in unity3D, the key technologies were used including environment understanding and human-computer interaction based on C# scripts, and a Chinese architectural history teaching system using HoloLens was implemented with core functions of building structure recognition and cultural cognition. The results show that the system has good 3D visual effects and natural effective human-computer interaction, which can improve the efficiency of knowledge transfer and the initiative of students.

Key words: mixed reality, interactive feature, three-dimensional space interface, teaching system

摘要：

针对传统中国建筑史教学建筑结构繁杂、局限于二维平面化教学、不易于学生理解等问题，提出构建一种基于混合现实技术的中国建筑史教学系统的实现方法。选取宁波保国寺大殿木构体系作为研究案例，采用混合现实设备微软HoloLens作为案例的教学平台。首先，基于收集的数据，在3ds Max中对保国寺大殿木构体系进行三维仿真建模，建立建筑模型库；然后，在unity3D中构建虚拟教学系统的三维空间操作界面，利用C#脚本，实现环境理解和多种人机交互等关键技术，构建以建筑结构识别和文化认知为核心功能的HoloLens教学系统。结果表明，该系统具备良好三维可视化的视觉效果和自然高效的人机交互方式，能有效提高知识的传递效率和学生的学习主动性。

关键词: 混合现实, 交互特征, 三维空间界面, 教学系统

CLC Number:

TP391.9

YAO Luji, ZHANG Li. Design and implementation of Chinese architecture history teaching system based on mixed reality technology[J]. Journal of Computer Applications, 2019, 39(9): 2689-2694.

姚陆吉, 章立. 基于混合现实技术的中国建筑史教学系统设计与实现[J]. 计算机应用, 2019, 39(9): 2689-2694.

References

[1] 李林瞳,王有春,谢晔,等.适用宇航智能交互场景的混合现实技术研究[J].计算机测量与控制, 2017,25(12):255-258.(LI L T, WANG Y C, XIE Y, et al. A study of mixed reality applied to aerospace intelligent interaction[J]. Computer Measurement and Control, 2017, 25(12):255-258.)
[2] 衡军.增强现实技术在船舶行业的应用[J].舰船科学技术,2014,36(12):103-106.(HENG J. Research on application of augumented reality technology in ship industry[J]. Ship Science and Technology, 2014, 36(12):103-106.)
[3] 廖屿荻,张兴国,杜源.从传统建筑到营造传统——重庆大学中国古典建筑史模型实践课程体系深化研究[J].高等建筑教育,2017,26(6):99-104.(LIAO Y D, ZHANG X G, DU Y. From traditional architecture to inheritance of building tradition:reflecting on the optimization teaching of Chinese classical architecture under the background of the new normal[J]. Journal of Architectural Education in Institutions of Higher Learning, 2017, 26(6):99-104.)
[4] 周坚.外国建筑史课程教学改革研究[J].高等建筑教育,2014,23(2):63-65.(ZHOU J. Teaching reform of foreign architectural history course[J]. Journal of Architectural Education in Institutions of Higher Learning, 2014, 23(2):63-65.)
[5] 李小平,张琳,赵丰年,等.虚拟现实/增强现实下混合形态教学设计研究[J].电化教育研究, 2017, 38(7):20-25.(LI X P,ZHANG L,ZHAO F N,et al.Research on AR/VR blended style instructional design[J]. E-Education Research,2017, 38(7):20-25.)
[6] MILGRAM P, KISHINO F. A taxonomy of mixed reality visual displays[J]. IEICE Transactions on Information and Systems, 1994, E77-D(12):1321-1329.
[7] 黄红涛,孟红娟,左明章,等.混合现实环境中具身交互如何促进科学概念理解[J]. 现代远程教育研究,2018(6):28-36.(HUANG H T, MENG H J, ZUO M Z, et al. How embodied ineraction facliltates the understanding of scientific concepts in mixed reality environment[J]. Modern Distance Education Research, 2018(6):28-36.)
[8] 陈宝权,秦学英.混合现实中的虚实融合与人机智能交融[J].中国科学:信息科学,2016, 46(12):1737-1747.(CHEN B Q,QIN X Y.Composition of virtual-real worlds and intelligence integration of human-computer in mixed reality[J].Scientia Sinica(Informationis),2016, 46(12):1737-1747.)
[9] 黄进,韩冬奇,陈毅能,等.混合现实中的人机交互综述[J].计算机辅助设计与图形学学报,2016,28(6):869-880.(HUANG J, HAN D Q, CHEN Y N, et al. A survey on human-computer interaction in mixed reality[J]. Journal of Computer-Aided Design and Computer Graphics, 2016, 28(6):869-880.)
[10] 黄鸣奋.艺术与混合现实[J].东南大学学报(哲学社会科学版), 2008,10(6):74-78.(HUANG M F. Art and mixed reality[J]. Journal of Southeast University (Philosophy and Social Science), 2008, 10(6):74-78.)
[11] 纪连恩,张凤军,付永刚,等.虚拟环境下基于语义的三维交互技术[J].软件学报,2006,17(7):1535-1543.(JI L E, ZHANG F J, FU Y G, et al. 3D interaction techniques based on semantics in virtual environments[J]. Journal of Software, 2006,17(7):1535-1543.)
[12] 梁思成.中国建筑史[M].北京:三联书店,2005:107-207.(LIANG S C. A History of Chinese Architecture[M]. Beijing:SDX Joint Publishing, 2005:107-207.)
[13] 潘谷西,何建中.《营造法式》解读[M].南京:东南大学出版社,2005:21-165.(PAN G X, HE J Z. Interpretation of Rules of Architecture[M]. Nanjing:Southeast University Press, 2005:21-165.)
[14] 淳庆,孟哲,贾肖虎,等.典型江南传统木构建筑的构件重要性分析方法[J].华侨大学学报(自然科学版),2019,40(1):64-71.(CHUN Q, MENG Z, JIA X H, et al. Evaluation methods of component importance of typical traditional timber buildings in yangtze river regions[J]. Journal of Huaqiao University (Natural Science), 2019, 40(1):64-71.)
[15] 张十庆.宁波保国寺大殿:勘测分析与基础研究[M].南京:东南大学出版社,2012:5-128.(ZHANG S Q. Ningbo Baoguo Temple Hall:Survey Analysis and Basic Research[M]. Nanjing:Southeast University Press, 2012:5-128.)
[16] 王丹婷,蒋友燏.古建筑三维虚拟建模与虚实交互软件实现[J].计算机应用, 2017,37(S2):186-189.(WANG D T, JIANG Y Y. 3D-virtual modeling for historic architecture and realization of virtual interactive software[J]. Journal of Computer Applications, 2017, 37(S2):186-189.)
[17] 廖宏建.应用Kinect构建英语课堂虚拟教学情境研究[J]. 现代教育技术,2014,24(3):64-70.(LIAO H J. Research on construting virtual context in English classroom teaching by Kinect[J]. Modern Educational Technology, 2014, 24(3):64-70.)