This paper presents the development of a smart robot assistant designed to enhance accessibility and independence for visually impaired individuals by leveraging Artificial Intelligence (AI), Machine Learning (ML), and Internet of Things (IoT) technologies. The system incorporates various sensors, including cameras, microphones, and distance sensors, with Raspberry Pi 4 and Nvidia RTX 3050 ti hardware to provide features such as voice recognition, obstacle detection, and navigation. The software is programmed using Python version 3.9.16 and utilizes important libraries such as Tensorflow, OpenCV, and PyAudio. Our study shows that the smart robot assistant can offer numerous benefits, including increased mobility, safety, and independence, by recognizing and responding to voice commands, identifying obstacles and avoiding collisions, and providing audio feedback on its location and surroundings. However, successful adoption requires addressing several challenges, including improving the accuracy and reliability of obstacle detection, ensuring privacy and security, and reducing costs. The propose strategies to overcome these challenges, such as leveraging AI and ML technologies, collaborating with stakeholders, and promoting regulatory frameworks. In conclusion, this paper highlights the potential of AI, ML, and IoT technologies in developing smart robots to enhance the accessibility and independence of visually impaired individuals. By addressing the aforementioned challenges and incorporating user feedback, these systems have the potential to significantly improve the quality of life for this population.

Keywords:

smart robot, visually impaired AI, ML, and IoT

References :


[1] International Journal of Engineering Research & Technology (IJERT) ISSN: 2278-0181 Published by, www.ijert.org ICACT - 2016 Conference Proceedings Special Issue - 2016.
[2] Ultrasonic Blind Stick for Completely Blind People to Avoid Any Kind of Obstacles Arnesh Sen Kaustav Sen Jayoti Das Jadavpur University: Dept. of Physics, Kolkata, India.
[3] PAPER • OPEN ACCESS Raspberry PI Based Smart Walking Stick to cite this article: M. Ganesan et al 2020 IOP Conf. Ser.: Mater. Sci. Eng. 981 042090.
[4] Yoann Dieudonné, Shlomi Dolev, Franck Petit, Michael Segal. Deaf, Dumb, and Chatting Robots, Enabling Distributed Computation and Fault-Tolerance Among Stigmergic Robots.
[Research Report] 2009, pp.15.
[5] International Journal of Computer Trends and Technology Volume 68 Issue 3, 13 15, March 2020 ISSN: 2231-2803 / https://doi.org/10.14445/22312803/IJCTT-V68I3P103 2020 Seventh Sense Research Group.
[6] Volume 5, Issue 4, April – 2020 International Journal of Innovative Science and Research Technology ISSN No:-2456-2165.
[7] Benachir B. Nouhaila ,Adekunle A. Adepoju(2022),Application of Aloe Vera-derived Plant-based Cell in Powering Wireless IoT devices in a Smart Greenhouse. IUSRJ International Uni-Scientific Research Journal (3)(19),126-132. https://doi.org/10.59271/s44768.022.2010.19
[8] Raspberry pi 4: https://static.raspberrypi.org/files/product-briefs/200521+Raspberry+Pi+4+Product+Brief.pdf.
[9] Raspberry Pi Camera v2: https://www.farnell.com/datasheets/2056179.pdf?_ga=1.152577328.880870297.1479740269
[10] Touch screen display: https://www.openhacks.com/uploadsproductos/hdmi_interface_5_inch_800x480_tft_display_-_elecrow.pdf.
[11] Power Supply: https://static.raspberrypi.org/files/product-briefs/USB-C-Product-Brief.pdf.
[12] PHOTOSENSITIVE RESISTANCE SENSOR: https://hobbycomponents.com/sensors/832-photosensitive-resistance-sensor-module.
[13] Water sensor: https://curtocircuito.com.br/datasheet/sensor/nivel_de_agua_analogico.pdf.
[14] Motors: https://media.digikey.com/pdf/Data%20Sheets/Adafruit%20PDFs/3777_Web.pdf.
[15] Motor Driver L298N: http://www.handsontec.com/dataspecs/L298N%20Motor%20Driver.pdf.
[16] Speaker: https://www.electroncomponents.com/4-inch-speaker-4-ohm-5watts.
[17] Ultrasonic: https://cdn.sparkfun.com/datasheets/Sensors/Proximity/HCSR04.pdf.
[18] Buzzer: http://electroniccomponentsindia.blogspot.com/2014/09/buzzers.html.
[19] Esp32: https://www.espressif.com/sites/default/files/documentation/esp32_datasheet_en.pdf
[20] GPU: https://developer.nvidia.com/cuda-gpus
[21] Flutter • https://www.javatpoint.com/flutter • https://www.fullstacklabs.co/blog/introduction-to-flutter • https://www.tutorialspoint.com/flutter/flutter_introduction.htm • https://litslink.com/blog/why-should-you-build-your-next-app-with flutter • https://www.zrix.com/blog/flutter-mobile-application-development • https://digitalskynet.com/blog/Ionic-vs-Flutter-vs-React-Native
[22] Python: • https://www.javatpoint.com/python-tutorial • https://techvidvan.com/tutorials/python-advantages-and-disadvantages/
[23] Python GUI: • https://www.gartner.com/en/information-technology/glossary/gui-graphical-user-interface • https://www.activestate.com/blog/top-10-python-gui-frameworks-compared/
[24] OCR: • https://aws.amazon.com/what-is/ocr/?nc1=h_ls • https://www.docacquire.com/resources/blog/what-is-ocr/ • https://www.geeksforgeeks.org/advantages-and-disadvantages-of-optical-character-reader-ocr/ • https://www.docdigitizer.com/blog/what-is-ocr/
[25] Raspberry Pi OS: • https://www.tutorialspoint.com/raspberry_pi/raspberry_pi_quick_guide.htm • https://picockpit.com/raspberry-pi/raspberry-pi-os-overview/ • https://linuxhint.com/what-is-raspberry-pi/ • https://robu.in/5-pros-and-5-cons-of-raspberry-pi/ • https://raspberrytips.com/raspberry-pi-pros-and-cons/ • https://www.educba.com/uses-of-raspberry-pi/ • https://www.oreilly.com/library/view/raspberry-pi-amazing/9781787128491/ch24s06.html
[26] Speech-to-text: • https://aws.amazon.com/what-is/speech-to-text/ • https://www.amberscript.com/en/blog/how-speech-to-text-software-works/#one • https://itchronicles.com/speech-to-text/ • https://www.rfwireless-world.com/Terminology/Advantages-and-Disadvantages-of-Text-to-Speech-Conversion.html • https://studylib.net/doc/7569205/advantages-and-disadvantages-of-voice-recognition---pac-itgs • https://itchronicles.com/speech-to-text/ • https://leaddesk.com/blog/speech-to-text-guide-for-contact-centers/.
[27] Voice Assistance: • https://www.santander.com/en/stories/everything-you-need-to-know-about-voice-assistants • https://alan.app/blog/voiceassistant-2/ • https://www.zdnet.com/home-and-office/smart-home/12-smart-home-devices-that-make-great-gifts-in-2022/ • https://www.miquido.com/blog/what-are-voice-assistants/ • https://blogs.oracle.com/marketingcloud/post/advantages-and-disadvantages-of-voice-assistants-for-marketers • https://www.techwalla.com/articles/the-disadvantages-of-voice-recognition-software • https://www.techulator.com/resources/18784-the-12-advantages-and-disadvantages-of-voice-user-interface • https://www.workstatus.io/blog/the-pros-and-cons-of-voice-assistants-in-the-workplace/
[28] Flask: • https://www.tutorialspoint.com/flask/flask_tutorial.pdf • https://www.analyticsvidhya.com/blog/2021/10/easy-introduction-to-flask-framework-for-beginners/
[29] AI, ML, and DL: • http://beamandrew.github.io/deeplearning/2017/02/23/deep_learning_101_part1.html • https://towardsdatascience.com/what-are-the-types-of-machine-learning-e2b9e5d1756f • https://codebots.com/artificial-intelligence/the-3-types-of-ai-is-the-third-even-possible • https://www.datasciencecentral.com/ai-ml-or-dl-learn-what-it-means\ • https://hypersense.subex.com/blog/ai-vs-ml-vs-dl-whats-the-difference/
[30] object detection: • https://d2l.ai/chapter_computer-vision/bounding-box.html#bounding-box • https://lilianweng.github.io/lil-log/2017/10/29/object-recognition-for-dummies-part-1.html • 3-https://www.v7labs.com/blog/object-detection-guide#h1 • https://medium.com/ml-research-lab/what-is-object-detection-51f9d872ece7 is
[31] TensorFlow: • https://www.guru99.com/what-is-tensorflow.html#9 • https://www.javatpoint.com/advantage-and-disadvantage-of-tensorflow • https://www.techtarget.com/searchdatamanagement/definition/TensorFlow • https://www.javatpoint.com/tensorflow
[32] Ubuntu on a Raspberry Pi: • https://ubuntu.com/download/raspberry-pi

Citation

Ahmed Adel, Ahmed Goda, Ahmed Essam, Mostafa Sadek, Mohammed Salama(2023),Enhancing Accessibility and Independence of Visually Impaired Individuals through AI, ML and IoT: The Development of a Smart Robot Assistant.. IUSRJ International Uni-Scientific Research Journal (4)(11),61-76. https://doi.org/10.59271/s45078.023.2301.11

Call for Paper

iusrj : Enhancing Accessibility and Independence of Visually Impaired Individuals through AI, ML and IoT: The Development of a Smart Robot Assistant.| IUSRJ

We are going to launch a new Volume, 15th of next Month of peer-reviewed OpenAcess journal publishing original research articles. IUSRJs' publish innovative papers, reviews, mini-reviews, rapid communications and scheduled to monthly. For this purpose, we would like to ask you to contribute your excellent papers in IUSRJs'. Your comments will help us improve the quality and content of the journals. The journals accepts Review Articles, Original Articles and Short Communications. Brief Report, Books Review, Thesis Important Info.: Last Date of article submission: 15th of Every month Acceptance Notification: within 4-5 weeks publication online: within 72 hours after submit all necessary document for publication Submit your valuable work: Submit Now Submit your article through : [email protected]

Contact Us

[email protected]