Description of the implementation options for the device for visual interpretation of the sound environment

Authors: Karpov I.E., Moskalik A.A.
Published in issue: #4(99)/2025
DOI:
Category: Informatics, Computer Engineering and Control | Chapter: System Analysis, Control, and Information Processing, Statistics
Keywords: sound visualization, technologies for people with hearing impairments, accessibility, inclusiveness, sound-to-visualization, spectrogram, oscillogram, real time, interactivity, portability
Published: 27.09.2025

This paper describes the development of a device that combines computer technology with sensory systems to visually interpret the sound environment. The goal of the study is to create an intuitive interface that will help users with hearing impairments perceive sound information through visual cues. The use of such technologies can significantly improve the quality of life of people with disabilities.

References

[1] Johnson M. Inclusive Technology: Bridging the Gap for the Deaf Community. Technology and Society Magazine, 2022.

[2] Smith J., Brown A. Sound to Sight: The Future of Auditory Augmentation. Journal of Assistive Technology, 2021.

[3] Samardzhiya A.Ch. Interactive augmented reality systems for urban tourism. Central European Conference on Information and Intelligent Systems, 2015, pp. 129-130. (In Russ.).

[4] Parton B.S., Hancock R., Dawson J. Augmented Reality for Deaf Students: Can Mobile Devices Make It Possible? HCIS 2010. Brisbane, Australia, 2010, pp. 309-312.

[5] Haptic 5G suits provide a unique live music listening experience for the deaf and hard of hearing. URL: https://www.vodafone.com/news/technology/5g-haptic-suits-unique-live-music-experience (accessed 15.02.2025).

[6] Cabanillas-Carbonell M., Cusi-Ruiz P., Prudencio-Galvez D., Herrera Salazar J.L. Mobile Application with Augmented Reality to Improve the Process of Learning Sign Language. Int. J. Interact. Mob. Technol., 2022, no. 16 (11), pp. 51–64. URL: https://online-journals.org/index.php/i-jim/article/view/29717 (accessed 15.02.2025).

[7] Berra S., Pernencar K., Almeida F. Silent augmented narratives. Inclusive augmented reality communication for the deaf and hard of hearing. Media & Jurnalismo, 2020, no. 20 (36), pp. 174–185.

[8] Sharma S., Shaikh S. Augmented Reality In Human Life. Journal For Research in Applied Science and Engineering Technology, 2022, vol. 10, no. V, pp. 3361–3362. https://doi.org/10.22214/ijraset.2022.43122

[9] Schall G. Mobile Augmented Reality for Human Scale Interaction with Geospatial Models. Springer Gabler, 2011, pp. 50–55.

[10] Miller A., Malasig J., Castro B. et al. The Use of Smart Glasses for Lecture Comprehension by Deaf and Hard of Hearing Students. CHI EA 17, 2017, pp. 1909–1915. https://doi.org/10.1145/3027063.3053117

[11] Liu Y., Zhang H. Machine Learning Approaches for Sound Recognition and Visualization. International Journal of Computer Applications, 2020.

[12] By 2032, the tactile technology market will exceed 17.49 billion US dollars with an average annual growth rate of 11.56 %. URL: https://www.linkedin.com/pulse/haptic-technology-market-size-surpass-usd-1749-billion-rashmi-s (accessed 15.02.2025).