SMARTASSIST: Android-based Smart Assistant Application for Individuals with Disabilities

Abstract

SmartAssist is an Android-based intelligent assistant application designed to facilitate mobile accessibility and personalize user experience for individuals with disabilities. The application focused on  visual and auditory accessibility requirements, resulting in a user-friendly, intuitive, and inclusive mobile application. Developed using Kotlin and Jetpack Compose, SmartAssist leverages Kotlin’s modern Android capabilities for a reliable and maintainable software structure. Jetpack Compose enables a component-based user interface design, allowing flexible screen transitions, state management, and user interactions in an accessible manner. Upon launching the application, users are greeted with a login screen and can register by providing their name, surname, and email. Users select either a visual or auditory mode according to their needs. In visual mode, large and clear buttons allow users to interact easily with reminders, music applications, and digital books, while text-based feedback supports individuals with hearing impairments. Users can convert spoken content into written text by pressing a dedicated button, enhancing accessibility for those who cannot hear. In auditory mode, users interact with the application entirely via voice commands. The system listens to the user’s spoken instructions and provides guidance, allowing them to create voice reminders that notify users when due, access digital books with audio playback, or control other applications such as opening music apps. Text-to-Speech and Speech-to-Text integration ensures users receive real-time auditory feedback, enabling fully hands-free and accessible interaction. This design, combined with the visual mode, ensures personalized, inclusive, and accessible experiences for users with diverse needs.