A Multimodal Robotic Communication System for Students with Profound and Multiple Disabilities

Main Article Content

Elmunir M. Elgajiji

Abstract

Different researches claim that using a robot to
play with students with profound and multiple disabilities
might be a valuable tool to increase the learning curve of
those students. Robots in schools and in other educational
environments is a growing research field and it seems that it
is time for technology to transform the education with
people of special needs similarly to how technology affected
mainstream education. The project focuses on using
different switches plugged in a joybox to send signals to
NAO Robot. Each switch caries a certain behavior. JoyBox
contains eight numbered connectors and four direction
connectors to move the robot. The paper implements client
server communication to connect to the robot and be able to
send signals to the robot via the switches connected to the
JoyBox. Using the switch enables the users to communicate
to NAO independently. This gauntness a deep level of
engagement with the robot, since the robot moves based on
the singles received from the switches. The paper describes
the setup of the client server communication, and the robot
knows which behaviour to implement next. This study
implements a case study evaluated by only four researchers
and staff from Oakfield school to evaluate the software .This
study hopes to be able to assess the needs of school staff to
improve communicational methods for students with
profound and multiple disabilities.

Article Details

How to Cite
Elmunir M. Elgajiji. (2024). A Multimodal Robotic Communication System for Students with Profound and Multiple Disabilities . The International Journal of Engineering & Information Technology (IJEIT), 1(2). https://doi.org/10.36602/ijeit.v1i2.434
Section
Artical

References

M. Ali, S. Alili, M. Warnier, And R. Alami. (2009). An

Archit ect ure Support ing Proact ive Robot Companion Behavior.

SSAISB: The Society for t he St udy of Art ificial Intelligence and

t he Simulat ion of Behaviour. 0 (0), p1-8.

J. Hedgecock. (2010). Can working wit h a robot enhance learning

in pupils with int ellect ual disabilit ies?. SCHOOL OF

COMMUNITY HEALTH SCIENCES. 0 (0), p1-85.

Department of Healt h. (2001). Valuing people: A new st rat egy

for learning disabilit y for the 21st century. London: HMSO.

D. BROWN, D. MCHUGH, P. STANDEN, L. EVETT, N.

SHOPLAND, and S. BATTERSBY, 2011. Designing locat ion

based learning experiences for people wit h intellect ual

disabilit ies and addit ional sensory impairment s. Comput ers &

Educat ion, 56 (1), pp. 11-20.

J. Tomlinson, (1997). Inclusive learning: the report of the

committee of enquiry into the post-school educat ion of those wit h

learning difficult ies and/or disabilit ies, in England 1996.

European Journal of Special Needs Educat ion, 12, 184–196.

P. STANDEN, and D. BROWN, 2005. Virt ual reality in the

rehabilitat ion of people with int ellect ual disabilit ies. Cyber

Psychology and Behavior, 8 (3), pp. 272-282.

J. Cromby, P. Standen, and D. Brown (1996). The pot ent ials of

virt ual environment s in the educat ion and training of people wit h

learning disabilities Journal of Int ellect ual Disability Research

:489–501.

V. Yu. Budkov, M. V. PRISCHEPA, A. L. Ronzhin, A. A. Karpov.

(2010). Mult imodal Human-Robot Int eraction. IEEE. 10 (4),

P485-P488.

B. Robins, F. Amirabdollahian, Z. Ji, K. Dautenhahn. (Sept . 1215,

.

Tact

ile interact ion with a humanoid robot for children

wit h aut ism: A case st udy analysis involving user requirement s

and result s of an init ial implementat ion. 19th IEEE Int ernat ional

Symposium on Robot and Human Int eract ive Communicat ion. 0

(0), P704-711.

R. Iovannone, G. Dunlap, H. Huber, and D. Kincaid, (2003)

Effect ive educat ional pract ices for st udent s with aut ism spectrum

disorders, Focus on Aut ism and Other Development al

Disabilit ies, 18, 150–166.

D. Hargreaves, (2006) A New Shape for Schooling? London:

SSAT.

B. Carpenter, (2010a) Disadvantaged, deprived and disabled,

Special Children, 193, 42-45.

R. Barber. (2013). Mult imodal human - robot interact ion.

Available:

htt p://robot icslab.uc3m.es/robot icslab/t opic.php?id_topic=12.

Last accessed 3rd, May, 2013.

A. Corrales; M. Malfaz; M. A. Salichs. Signage syst em for the

navigat ion of aut onomous robot s in indoor environment s. IEEE

Transact ions on Industrial Informatics. In press. Vol. 0. No. .

pp.0-0. 2013.

Y. Xu, and H. Mellmann (2010). Adaptive Mot ion Control:

Dynamic Kick for a Humanoid Robot . Inst it ut fur Informat ik,

LFG Kunst liche Intelligenz. 1 (1), p1-8.

A. Jaime, S. Fabian, S. Norman, W. Daniel, (2013). CogSys-

Project-B: Project Nao Final Version. cogsys.. 1 (1), p1-43.