Interactive Multi-Sensory Environments for Children with Autism Spectrum Disorders

Vytautas Zalys

doi:10.18662/lumproc/atee2020/39

Vytautas Zalys Siauliai University, Siauliai, Lithuania

DOI: https://doi.org/10.18662/lumproc/atee2020/39

Keywords: interactive audiovisual technologies, ASD, sound

Abstract

The emerging of digital technology not only encourages the development of new tools but also changes traditional approaches to solving emerging problems. The sound, music, art, colors, etc. that prevailed in the 20th-century forms of therapy are being replaced by integrated systems that overcome many of these forms, thanks to digital technology. With the increasing number of people with autism spectrum disorder (ASD) in the world, such systems provide new opportunities for the treatment of these disorders. In this research, the creation of such a system has been chosen as the object of work. The article presents an interactive tool for the education of children with ASD created by audio, video, and computer technologies and assesses its potential impact. The experimental research and its results are presented. This study aims to evaluate an interactive instrument developed for the education of such children. Following the objectives of ensuring the interactivity of the process, provoking all the perceptions of the subject, and developing the subject's ability to respond to the environment, a personalized audiovisual environment was created. For interactivity, the virtual program EyeCon, Webcam and camcorders, video projector, and speaker system were used. The study was conducted with one subject and a case study method was used. The impact of the instrument was established based on a survey of the parents of the child and the findings of childcare experts. The results of the study demonstrated the positive benefits for this child such as increased eye-to-hand coordination, concentration duration, improved communication, and emotional expression. The results obtained show that such interactive multi-sensory environments in special and general education schools can be a supplemental tool for traditional methods.

References

Ainscow, M., Dyson, A., & Weiner, S. (2013). From exclusion to inclusion. Centre for Equity in Education, University of Manchester.

Ališauskienė, S., & Miltenienė, L. (2018). Inkliuzinis ar įtraukusis ugdymas: socialinių konstruktų interpretacijos švietimo kaitos kontekste. Specialusis ugdymas, 1(38), 11-32.

American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). American Psychiatric Association.

Auerbach, C., & Sperling, P. (1974). A common auditory-visual space: Evidence for its reality. Perception & Psychophysics, 16(1), 129-135.

Bach, D. R., Seifritz, E., & Dolan, R. J. (2015). Temporally Unpredictable Sounds Exert a Context-Dependent Influence on Evaluation of Unrelated Images. PLoS ONE, 10(6), e0131065. https://doi.org/10.1371/journal.pone.0131065

Bantjes, R. (2019). Prie-Cinema, Prie-GIFF, or Auto-Erotic Machine Art? Artech 2019 – 9th International Conference on Digital and Interactive Arts. Braga, Portugal. pp. 1-8.

Berard, G., & Brockett, S. (2011). Hearing equals behavior: Updated and expanded. Northshire Press.

Bomba, M., & Pang, E. W. (2004). Cortical auditory evoked potentials in autism: A review. International Journal of Psychophysiology, 53, 161-168.

Boucenna, S., Narzisi, A., Tilmont, E., Muratori, F., Pioggia, G., Cohen, D., & Chetouani, M. (2014). Interactive Technologies for Autistic Children: A Review. Springer.

Brockett, S., Lawton-Shirley, N., & Giencke-Kimball, J. (2014). Berard auditory integration training: Behavior changes related to sensory modulation. Autism Insights, 6, 1-10.

Brooks, A. L. (2005). Enhanced Gesture Capture in Virtual Interactive Space (VIS). Digital Creativity. Computers in Art and Design Education, 16(1), 43-53.

Cowan, K. (2013). Multimodal transcription of video: examining interaction in Early Years classrooms. The University of London.

Curry, D. G., E. Meyer, J. E., & McKinney, J. M. (2006). Seeing versus perceiving. What you see isn‘t always what you get. Professional Safety, 51(6), 28-34.

Frith, U. (2008). Autism: A Very Short Introduction. Oxford University Press.

Golan, O., Ashwin, E., Granader, Y., McClintock, S., Day, K., Leggett, V., & Baron-Cohen, S. (2010). Enhancing emotion recognition in children with autism spectrum conditions: an intervention using animated vehicles with real emotional faces. Journal of Autism and Developmental Disorders, 40(3), 269-279.

Gonsalves, T. (2010). Empathy and Interactivity: Creating Emotionally Empathic Circuits between Audiences and Interactive Arts. New Realities: Being Syncretic, Proceedings of the IXth Consciousness Reframed Conference, Vienna, pp. 136-139.

Jeste, S. S., & Nelson, C. A. (2009). Event related potentials in the understanding of autism spectrum disorders: An analytical review. Journal of Autism and Developmental Disorders, 39(3), 495-510.

Jolij, J., & Meurs, M. (2011). Music Alters Visual Perception, Plos One, 6(4). https://doi.org/10.1371/journal.pone.0018861

Jordan, R. (1995). Computer assisted education for individuals with autism. Paper presented at the Autism France 3rd International Conference.

La´nyi, C. S., & Tilinger, A. (2004). Multimedia and virtual reality in the rehabilitation of autistic children. Computers helping people with special needs. Springer.

Lai, M.-C., Lombardo, M. V., Baron-Cohen, S. (2013). Autism. The Lancet, 383(9920), 896-910.

Lansdown, G., Groce, N., Deluca, M., Cole, E., Berman-Bieler, R., Mitra, G., Farkas, A., Sabbe, L., & Burlyaeva-Norman, A. (2013). Children and Young People with Disabilities (Fact Sheet). UNICEF.

Meyer, G. F., Wuerger, S., & Greenlee, M. (2011). Interactions between Auditory and Visual Semantic Stimulus Classes: Evidence for Common Processing Networks for Speech and Body Actions. Journal of Cognitive Neuroscience, 23(9), 2291-2308.

Mostofsky, S. H., Dubey, P., Jerath, V. K., Jansiewicz, E. M., Goldberg, M. C., & Denckla, M. B. (2006). Developmental dyspraxia is not limited to imitation in children with autism spectrum disorders. Journal of the International Neuropsychological Society, 12, 314–326.

Nelson, C. (2012). Across The Spectrum. Teaching Children with Autism, 51-57.

O’Connor, K. (2012). Auditory processing in autism spectrum disorder: A review. Neuroscience and Biobehavioral Reviews, 36(2), 836-854.

Powers, M. D. (2000). Children with autism: A parents’ guide. Woodbine House.

Preece, D., & Howley, M. (2018). An approach to supporting young people with autism spectrum disorder and high anxiety to re-engage with formal education – the impact on young people and their families. International Journal of adolescence and Youth, 23(4), 468-481.

Saito, D. N., Yoshimura, K., Kochiyama, T., Okada, T., Honda, M., & Sadato, N. (2005). Cross-modal Binding and Activated Attention Networks during Audiovisual Speech Integration: a Functional MRI Study. Cerebral Cortex, 15(11), 1750-1760. https://doi.org/10.1093/cercor/bhi052

Santomauro, D., Sheffield, J., & Sofronoff, K. (2017). Investigations into emotion regulation difficulties among adolescents and young adults with an autism spectrum disorder. A qualitative study journal of intellectual & developmental disability, 42(3), 275-284.

Scott, S. (2016). The Challenges of Imitation for Children with Autism Spectrum Disorders with Implications for General Music Education. National Association for Music Education, 34(2), 13-20.

Smith, I. M., & Bryson, S. E. (2007). Gesture imitation in autism II: Symbolic gestures and pantomimed object use. Cognitive Neuropsychology, 24, 679-700.

Sokhadze, E. M., Casanoval, M. F., Tasman, A., & Brockett, S. (2016). Electrophysiological and Behavioral Outcomes of Berard Auditory Integration Training (AIT) in Children with Autism Spectrum Disorder. Springer Science+Business Media.

Stiegler, L. N., & Davis, R. (2010). Understanding Sound Sensitivity in Individuals with Autism Spectrum Disorders. Focus on Autism and Other Developmental Disabilities, 25(2), 67–75.

Valle, A. (2010). Environmental Sound Synthesis, Processing, and Retrieval. Journal on Audio, Speech, and Music Processing, 1, 1-3.

Vicente-Yagüe, M. I. & Guerrero Ruiz, M. I. J. P. (2015). El cuento musical. Análisis de sus componentes textuales, musicales e ilustrados para el desarrollo de las competencias básicas en educación primaria. Profesorado: revista de curriculum y formación del profesorado, 19(3), 398-418.

Vivanti, G., Nadig, A., Ozonoff, S., & Rogers, S. J. (2008). What do children with autism attend to during imitation tasks? Journal of Experimental Psychology, 101, 186-205.

Voisin, J., Bidet-Caulet, A., Bertrand, O., & Fonlupt, P. (2006). Listening in Silence Activates Auditory Areas: A Functional Magnetic Resonance Imaging Study. The Journal of Neuroscience, 26(1), 273-278.

Whitehouse, A. J. O., & Bishop, D. V. M. (2008). Do children with autism ‘switch off’ to speech sounds? An investigation using event-related potentials. Developmental Science, 11(4), 516-524.

Williams, D. L., Goldstein G. G., & Minshew N. J. (2013). The Modality Shift Experiment in Adults and Children with High Functioning Autism. Journal of Autism and Developmental Disorders, 43(4), 794-806.

Zajonc, R. B. (2000). Feeling and thinking: Closing the debate over the independence of affect. In J. P. Forgas (Ed.), Studies in emotion and social interaction, second series. Feeling and thinking: The role of affect in social cognition (pp. 31-58). Cambridge University Press.