Webcam Based Eye Interactive System for Locked-In Syndrome Patients

Emmanuel Effah, J. A. Addo

Abstract


Locked-In Syndrome (LIS) patients cannot move nor talk but in most cases have the ability to blink and move their eyes. This project harnesses the blinking abilities of LIS Patients from a live video stream as a way of interacting with a computer system. Farneback’s optical flow image processing algorithm is applied to the frames of the video stream to read blinks. Face detection technique is employed just to increase the probability of detecting the eyes in a frame. The various input gestures (short and long blinks) are used to trigger corresponding events to execute a particular action. The resulting system can be used in the home and in any favorable environment where there is enough light. The system will help LIS patients to communicate, improve the quality of life of LIS patients and immensely widen the area of Human-Computer Interaction (HCI). The mammoth novelty of this paper is the fact that we deployed the ubiquitous Webcam accessory of the Computer

 

Keywords:Locked-In Syndrome; Live Video Stream; Farneback’s Algorithm; Face Detection; Input Gesture; Human-Computer Interaction, Blink.


Keywords


Locked-In Syndrome; Live Video Stream; Farneback’s Algorithm; Face Detection; Input Gesture; Human-Computer Interaction, Blink.

Full Text:

PDF

References


Agyemang, C., Attah-Adjepong, G., Owusu-Dabo, E., De-Graft A. A., Addo, J., Edusei, A. K., Nkum, B. C., Ogedegbe, G., (2012), “Stroke in Ashanti region of Ghana”, Ghana Medical Journal, Vol. 46, pp. 12 –17.

Anon., (2005), “Eye tracking on the ISS”, https://en.wikipedia.org/wiki/Eye_trackin g_on_the_ISS. Assessed: March 22, 2016.

Anon., (2007a), “Dasher”, Better Living through Technology, http://www.bltt.org/software/dasher/. Assessed: March 20, 2016.

Anon., (2007b), “Locked-In Syndrome”, http://www.ninds.nih.gov/disorders/locke dinsyndrome/lockedinsyndrome.htm. Assessed: February 18, 2016.

Anon., (2010), “Why ICT for Health”, http://www.ictforhealth.net/index.php?opt ion=com_content&view=article&id=4 5&Itemid=27. Assessed: March 17, 2016.

Anon. (2014), “Haar Feature-based Cascade Classification for Object Detection”, http://www.docs.opencv.org/2.4/modules/ objdetect/doc/cascade_classifier.html. Assessed: March 22, 2016.

Baumstarck, K., Alessandrini, M., Blandin, V., Villemeur, T. B. and Auquier, P., (2015), “Quality of life in patients with locked-in syndrome: Evolution over a 6-year period”, Orphanet Journal of Rare Diseases, pp. 1 – 8.

Butter, M., Rensma, A., Boxsel, J. V., Kalisingh, S., Schoone, M., Leis, M., Gelderblom, G.J., Cremers, G., Wilt, M., Kortekaas, W., Thielmaan, A., Cuhls, K., Sachinopoulou, A., Korhonen, I., (2008), “Robotics for healthcare”, Innovation for life, Vol. 5, pp. 4 – 5.

Gonzalez, R. C. and Woods, R. E., (2008) “Digital Image Processing”, Prentice Hall, pp. 1 – 3.

Miller, F. P., Vandome, A. F., McBrewster J., (2010), “Image Processing”, VDM Publising, pp. 72

Lienhart, R. and Maydt, J., (2002), “An Extended Set of Haar-like Features for Rapid Object Detection”, Proceedings of the IEEE Transactions on ICIP, Vol. 1, pp. 900-903.

Merriam-Webster Dictionary, “Communication” http://www.merriamwebster.com/dictiona ry/communication , Assessed: May 30, 2016.

Patterson, J. and R., Grabois, M. (1986), “Locked-in syndrome: a review of 139 cases”, American Heart Association, Vol. 17, No.4, pp. 758 – 763.

Sarfraz, M., (2013), “Intelligent Computer Vision and Image Processing”, Information Science Reference, 701 E. Chocolate avenue, Hershey PA 17033, pp. XV.

Soegaard, M., Dam and R. F., (2002), “The Encyclopaedia of Human-Computer Interaction”, https://www.interaction -design.org/literature/book/the -encyclopedia-of-human-computer -interaction-2nd-ed. Assessed: March 10, 2016.

Tabassum S. N., (2012), “Digital Computing Image Processing Network Technology”, International Journal of Scientific and Engineering Research, Vol. 3, pp. 3 – 4.

Weiss, T. C., (2015), “OptiKey is an assistive on -screen keyboard designed to bring mouse, keyboard, and speech control to people with speech and motor limitations”, http://www.disabled-world.com/assistive devices/computer/optikey.php. Assessed: March 22, 2016.


Refbacks

  • There are currently no refbacks.