[1]杨铮,方慧娟,罗继亮,等.混合脑机接口系统的眨眼与运动想象控制方法[J].华侨大学学报(自然科学版),2022,43(2):252-259.[doi:10.11830/ISSN.1000-5013.202012008]
　YANG Zheng,FANG Huijuan,LUO Jiliang,et al.Hybrid Brain Computer Interface System Based on Blink and Motor Imagery Control Method[J].Journal of Huaqiao University(Natural Science),2022,43(2):252-259.[doi:10.11830/ISSN.1000-5013.202012008]
点击复制

混合脑机接口系统的眨眼与运动想象控制方法()
分享到：

《华侨大学学报（自然科学版）》[ISSN:1000-5013/CN:35-1079/N]

卷:
第43卷
期数:
2022年第2期
页码:
252-259
栏目:
出版日期:
2022-03-08

文章信息/Info

Title:
Hybrid Brain Computer Interface System Based on Blink and Motor Imagery Control Method
文章编号:
1000-5013(2022)02-0252-08
作者:
杨铮1;  方慧娟1; 2;  罗继亮1; 2;  孙海信3
1. 华侨大学 信息科学与工程学院, 福建 厦门 361021;2. 华侨大学 福建省电机控制与系统优化调度工程技术研究中心, 福建 厦门 361021;3. 厦门大学 信息学院, 福建 厦门 361005
Author(s):
YANG Zheng1;  FANG Huijuan1; 2;  LUO Jiliang1; 2;  SUN Haixin3
1. College of Information Science and Engineering, Huaqiao University, Xiamen 361021, China; 2. Fujian Engineering Research Center of Motor Control and System Optimal Schedule, Huaqiao University, Xiamen 361021, China; 3. School of Informatics, Xiamen Uni
关键词:
眨眼控制;  眼部纵横比;  眨眼次数;  实时干预
Keywords:
blink control;  eye aspect ratio;  blink times;  real-time intervention
分类号:
TP242.6
DOI:
10.11830/ISSN.1000-5013.202012008
文献标志码:
A
摘要:
针对单一运动想象脑机接口实验控制命令数量不足的问题,在单一运动想象系统的基础上,提出基于眨眼控制干预移动机器人的研究方法.首先,采用主动形状模型算法进行人脸识别和人眼定位;然后,利用眼部纵横比算法计算实时的数值,实现实时眨眼次数的统计;最后,将与眨眼次数相匹配的眨眼策略转化为对应指令控制移动机器人运行,进而实现通过眨眼和运动想象控制实时干预移动机器人状态的目的.为了验证该方法的有效性,邀请数位受试者进行基于眨眼和运动想象控制的混合实验.实验结果表明:该方法能够准确、高效地干预移动机器人的实时状态.
Abstract:
Aiming at the problem of insufficient number of experimental control commands of single motor imagery brain computer interface, a research method of intervening mobile robot based on blink control is proposed on the basis of single motor imagery system. Firstly, the active shape model algorithm is used for face recognition and eye positioning. Then, the eye aspect ratio algorithm is used to calculate the real-time value to achieve real-time blink count statistics. Finally, the blink strategy which matches the blink count is converted into corresponding instructions to control the operation of the mobile robot, which can realize real-time intervention through blinking and motor imagery control the purpose of the state of the mobile robot. In order to verify the effectiveness of this method, several experimenters are invited to conduct a hybrid experiment based on blinking and motor imagery control. The experimental results show that this method can intervene the sta-te of the mobile robot accurately and efficiently in the real-time.

参考文献/References:

[1] 袁保宗,阮秋琦,王延江,等.新一代(第四代)人机交互的概念框架特征及关键技术[J].电子学报,2003,31(增刊1):1945-1954.DOI:10.3321/j.issn:0372-2112.2003.z1.003.
[2] WOLPAW J R,BIRBAUMER N,HEETDERKS W J,et al.Brain-computer interface technology: A review of the fimt intemational meeting[J].IEEE Transaction on Rehabilitation Engineering,2000,8(2):164-173.DOI:10.1109/TRE.2000.847807.
[3] 郑汝琴.物联网智能家居中的人机交互浅析[J].科学技术创新,2019(16):79-80.
[4] PFURTSCHELLER G,ALLISON B Z,BRUNNER C,et al.The hybrid BCI[J].Frontiers in Neuroscience,2010,4(30):30-40.DOI:10.3389/fnpro.2010.00003.
[5] 张浩,李远清,张瑞,等.室内环境中脑控轮椅的路径跟踪控制[J].计算机测量与控制,2015,23(1):93-95.DOI:10.16526/j.cnki.11-4762/tp.2015.01.085.
[6] 窦立祥.基于稳态视觉诱发电位和运动想象的混合脑机接口系统研究与实现[D].天津:天津理工大学,2018.
[7] 刘祎,欧阳健飞,闫勇刚.基于iPPG 的非接触式心率测量方法研究[J].计量技术,2015(4):3-5.DOI:10.3969/j.issn.1000-0771.2015.4.01.
[8] LEVANTINI V,MURATORI P,INGUAGGIATO E,et al.Eyes are the window to the mind: Eye-tracking technology as a novel approach to study clinical characteristics of ADHD[J].Psychiatry Research,2020,290:113135.DOI:10.1016/j.psychres.2020.113135.
[9] PAULY L,SANKAR D.A novel method for eye tracking and blink detection in video frames[C]//IEEE International Conference on Computer Graphics,Vision and Information Security.Bhubaneswar:IEEE Press,2015:252-257.DOI:10.1109/CGVIS.2015.7449931.
[10] 陈燕军.基于Kinect的人体骨骼信息提取与手势识别[J].机械工程与自动化,2020(4):173-175.DOI:10.3969/j.issn.1672-6413.2020.04.070.
[11] 汪小帆.基于眨眼检测与瞳孔定位的疲劳驾驶状态检测[D].马鞍山:安徽工业大学,2018.
[12] COOTES T F,TAYLOR C J.Active shape models: ‘Smart snakes’[C]//Proceedings of the British Machine Vision Conference.Leeds:Springer,1992:266-275.DOI:10.1007/978-1-4471-3201-1_28.
[13] ZHANG Ridong,JIA Kebin.Local two-dimensional principal component analysis algorithm for facial expression recognition[J].Computer Applications and Software,2018,35(2):172-177.DOI:10.3969/j.issn.1000-386x.2018.02.032.
[14] TU Jilin,TAO Hai,HUANG T.Face as mouse through visual face tracking[C]//Proceedings of the 2nd Canadian conference on Computer and Robot Vision.Washington D C:IEEE Press,2005:339-346.DOI:10.1109/CRV.2005.39.
[15] MEDIONI G,COHEN I,BREMOND F,et al.Event detection and analysis from video stream[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2001,23(8):873-889.DOI:10.1109/34.946990.
[16] 龙伶敏.基于Adaboost的人脸检测方法及眼睛定位算法研究[D].成都:电子科技大学,2008.
[17] 冯晶.基于AdaBoost算法的人脸检测系统研究及其SoC实现[D].南京:南京航空航天大学,2017.
[18] 余洪山,王耀南.一种改进型Canny边缘检测算法[J].计算机工程与应用,2004,40(20):27-29.DOI:10.3321/j.issn:1002-8331.2004.20.009.

备注/Memo

备注/Memo:
收稿日期: 2020-12-02
通信作者: 方慧娟(1979-),女,讲师,博士,主要从事脑机接口和智能控制的研究.E-mail:huijuan.fang@163.com.
基金项目: 国家重点研发计划项目(2018YFC0809200); 国家自然科学基金资助项目(605-53119043); 福建省自然科学基金资助项目(2017J01117); 福建省本科高校教育教学改革研究项目(FBJG20190203)http://www.hdxb.hq
更新日期/Last Update: 2022-03-20