|本期目录/Table of Contents|

[1]安兴伟+,曹勇+,綦宏志,等.语义匹配性及刺激间隔对视听双模态脑控字符输入系统的影响[J].天津大学学报(自然科学版),2018,(01):103-110.[doi:10.11784/tdxbz201702038]
 An Xingwei+,Cao Yong+,Qi Hongzhi,et al.Effects of Semantic Congruency and Stimulus-Onset Asynchrony on Audiovisual Bimodal Stimuli Based BCI Speller[J].Journal of Tianjin University,2018,(01):103-110.[doi:10.11784/tdxbz201702038]
点击复制

语义匹配性及刺激间隔对视听双模态脑控字符输入系统的影响()
分享到:

《天津大学学报(自然科学版)》[ISSN:0493-2137/CN:12-1127/N]

卷:
期数:
2018年01
页码:
103-110
栏目:
出版日期:
2018-01-08

文章信息/Info

Title:
Effects of Semantic Congruency and Stimulus-Onset Asynchrony on Audiovisual Bimodal Stimuli Based BCI Speller
文章编号:
0493-2137(2018)01-0103-08
作者:
安兴伟1+ 曹勇2+ 綦宏志3 焦学军2* 明东13*
1. 天津大学医学工程与转化医学研究院,天津 300072;2. 中国航天员科研训练中心人因工程国防科技重点实验室,北京 100092;3. 天津大学精密仪器与光电子工程学院,天津 300072
Author(s):
An Xingwei1+ Cao Yong2+ Qi Hongzhi3 Jiao Xuejun2* Ming Dong13*
1. Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, China
2. National Key Laboratory of Human Factors Engineering, China Astronaut Research and Training Center, Beijing 100092, China
3. School of Precision Instrument and Opto-Electronics Engineering, Tianjin University, Tianjin 300072, China
关键词:
脑机接口 事件相关电位 双模态 刺激间隔
Keywords:
brain-computer interface(BCI) event-related potential(ERP) bimodal stimulus-onset asynchrony (SOA)
分类号:
R318
DOI:
10.11784/tdxbz201702038
文献标志码:
A
摘要:
近年来, 基于事件相关电位(ERP)的脑控字符输入系统的研究越来越多, 视觉与听觉的多模态刺激范式作为一种新型的复合刺激越来越受到关注.然而, 研究视听双模态刺激的脑控字符输入系统性能因素的文章却很少报道.本研究旨在初步探究视听觉刺激的语义匹配性以及刺激间隔(SOA)对视听双模态脑控字符输入系统的影响.为此, 本研究设计了语义匹配、语义失配两种刺激范式, 每种范式又设置两种不同的刺激间隔(200 ms或400 ms).10名健康被试参与了本实验, 通过对比事件相关电位特征、可分性及分类正确率发现视听觉匹配性、刺激间隔以及两者交互作用对非目标刺激大脑反应、目标刺激大脑反应及其可分性都有显著性影响, 且视听觉的匹配性对视听联合脑控字符输入系统分类正确率影响显著, 但是不同刺激间隔脑机接口分类正确率之间并无显著性差异.本研究的结果能够为基于双模态刺激脑控字符输入系统的范式选择和优化提供一定的指导意见.
Abstract:
In recent years,researches on event-related potential(ERP)-based brain computer interface(BCI)speller have become increasingly popular. Visual and auditory based multimodal stimuli paradigms as new paradigms have attracted more and more attention. Studies on the effect of experimental parameters on system performance of visual-auditory stimuli based BCI speller have rarely been reported. This study aims at investigating the effects of audiovisual semantic congruency and stimulus-onset asynchrony(SOA)on audiovisual bimodal stimuli based BCI speller. Therefore,two audiovisual paradigms(semantic congruent and semantic incongruent)with two different SOAs(200 ms and 400 ms)were adopted,and 10 healthy subjects participated in the experiment. ERP,discrimination of targets and non-targets,and classification accuracy were analyzed. Results indicated that semantic congruency,SOA and the interaction factors have significant effect on the brain response and discrimination of target and non-target stimuli. Semantic congruency also has significant effect on system classification accuracy,whereas no significant difference was found on factor SOA. This study could provide a theoretical guidance for the design of new paradigms on visual and auditory based bimodal BCI speller.

参考文献/References:

[1] Wolpaw J, Wolpaw E W. Brain-Computer Interfaces:Principles and Practice[M]. USA:OUP, 2012.
[2] Wolpaw J R, Birbaumer N, Heetderks W J, et al. Brain-computer interface technology:A review of the first international meeting[J]. IEEE Transactions on Rehabilitation Engineering, 2000, 8(2):164-173.
[3] Mak J N, Wolpaw J R. Clinical applications of brain-computer interfaces:Current state and future prospects [J]. IEEE Reviews in Biomedical Engineering, 2009, 2(1):187-199.
[4] Walter W, Cooper R, Aldridge V J, et al. Contingent negative variation:An electric sign of sensori-motor association and expectancy in the human brain[J]. Nature, 1964, 203(4943):380-384.
[5] Fabiani Monica, Gratton Gabriele, Karis Demetrios, et al. Definition, identification, and reliability of measurement of the P300 component of the event-related brain potential[J]. Advances in Psychophysiology, 1987, 2(S1):1-78.
[6] Farwell Lawrence Ashley, Donchin Emanuel. Talking off the top of your head:Toward a mental prosthesis utilizing event-related brain potentials[J]. Electro-encephalography and Clinical Neurophysiology, 1988, 70(6):510-523.
[7] Brunner P, Joshi S, Briskin S, et al. Does the P300 speller depend on eye gaze?[J]. Journal of Neural Engineering, 2010, 7(5):056013.
[8] Treder M S, Blankertz B. (C)overt attention and visual speller design in an ERP-based brain-computer interface [J]. Behavioral and Brain Functions, 2010, 6(1):6-28.
[9] Treder Matthias Sebastian, Schmidt Nico Maurice, Blankertz Benjamin. Gaze-independent brain-computer interfaces based on covert attention and feature attention [J]. Journal of Neural Engineering, 2011, 8(6):066003.
[10] Guo Jing, Gao Shangkai, Hong Bo. An auditory brain-computer interface using active mental response[J]. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2010, 18(3):230-235.
[11] Brouwer Anne-Marie, van Erp Jan B F. A tactile P300 brain-computer interface[J]. Frontiers in Neuro-science, 2010, 4(19):1-11.
[12] Riccio Angela, Mattia Donatella, Simione L, et al. Eye-gaze independent EEG-based brain-computer interfaces for communication[J]. Journal of Neural Engineering, 2012, 9(4):045001.
[13] Aloise F, Lasorsa I, Schettini F, et al. Multimodal stimulation for a P300-based BCI[J]. International Journal of Bioelectromagnetism, 2007, 9(3):128-130.
[14] An Xingwei, H?hne Johannes, Ming Dong, et al. Exploring combinations of auditory and visual stimuli for gaze-independent brain-computer interfaces[J]. PloS One, 2014, 9(10):e111070.
[15] Wang Fei, He Yanbin, Pan Jiahui, et al. A novel audiovisual brain-computer interface and its application in awareness detection[J]. Scientific Reports, 2015, 5:9962.
[16] Chang Moonjeong, Nishikawa Nozomu, Cai Zhenyu, et al. Psychophysical responses comparison in spatial visual, audiovisual, and auditory BCI-spelling paradigms [C]//Joint, International Conference on Soft Computing and Intelligent Systems. Kobe, Japan, 2154-2157.
[17] Belitski A, Farquhar J, Desain P. P300 audio-visual speller[J]. Journal of Neural Engineering, 2011, 8(2):025022.
[18] Chang M, Nishikawa N, Struzik Z R, et al. Comparison of P300 responses in auditory, visual and audiovisual spatial speller BCI paradigms[J]. Computer Science, 2013.
[19] McFarland D J, Sarnacki W A, Townsend G, et al. The P300-based brain-computer interface(BCI):Effects of stimulus rate[J]. Clinical Neurophysiology, 2011, 122(4):731-737.
[20] Lu Jessica, Speier William, Hu Xiao, et al. The effects of stimulus timing features on P300 speller performance [J]. Clinical Neurophysiology, 2013, 124(2):306-314.
[21] 安兴伟. 基于数字拼写的视-听联合刺激诱发 ERP 研究[D]. 天津:天津大学精密仪器与光电子工程学院, 2010.
An Xingwei. Research on Event-Related Potentials (ERP)Evoked by Visual-Auditory Cross Stimulation Based on Number Speller[D]. Tianjin:School of
Precision Instrument and Opto-Electronics Engineering, Tianjin University, 2010(in Chinese).
[22] H?hne Johannes, Krenzlin Konrad, D?hne Sven, et al. Natural stimuli improve auditory BCIs with respect to ergonomics and performance[J]. Journal of Neural Engineering, 2012, 9(4):045003.
[23] An Xingwei, Ming Dong, Sterling Douglas, et al. Optimizing visual-to-auditory delay for multimodal BCI speller[C]//Proceedings of the 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Chicago, USA, 2014:1226-1229.
[24] Chang Chih-Chung, Lin Chih-Jen. LIBSVM:A library for support vector machines[J]. ACM Transactions on Intelligent Systems and Technology(TIST), 2011, 2(3):1-27.
[25] Efron Bradley. Bootstrap Methods:Another Look at the Jackknife [M]. New York, USA:Springer, 1992.
[26] Hesterberg T, Moore D S, Monaghan S, et al. Bootstrap methods and permutation tests[J]. Introduction to the Practice of Statistics, 2005, 5:1-70.

相似文献/References:

[1]綦宏志,等. 基于SVM特征优化的Farwell虚拟矩阵字符识别[J].天津大学学报(自然科学版),2011,(09):829.
 QI Hong-zhi,SUN Chang-cheng,et al. Character Identification in Farwell Imaginary Matrix Based on SVM Feature Optimization[J].Journal of Tianjin University,2011,(01):829.
[2]沈丽丽,刘海鹏,王丛,等.旋转偏差对立体显示舒适度影响的ERP研究[J].天津大学学报(自然科学版),2017,(04):385.[doi:10.11784/tdxbz201509081]
 Shen Lili,Liu Haipeng,Wang Cong,et al.Study on ERP for the Effect of Rotation Distortions on Visual Comfort[J].Journal of Tianjin University,2017,(01):385.[doi:10.11784/tdxbz201509081]

备注/Memo

备注/Memo:
收稿日期: 2017-02-21; 修回日期: 2017-06-06.
+并列第一作者:安兴伟(1985—), 女, 博士, anxingwei@tju.edu.cn; 曹勇(1993—), 男, 硕士研究生, caoyong_93@163.com.
*并列通讯作者: 明东, richardming@tju.edu.cn; 焦学军, jxjisme@sina.com.
基金项目: 国家自然科学基金资助项目(61603269, 81671861, 81630051); 中国博士后科学基金资助项目(2017M610162).
Supported by the National Natural Science Foundation of China(No.,61603269, No.,81671861 and No.,81630051)and the China Postdoctoral Science Foundation(No.,2017M610162).
更新日期/Last Update: 2018-01-10