Real-time Multilingual Audio Health Assistant

Introduction

The Real-time Multilingual Audio Health Assistant is an intelligent voice-based application designed to assist users in managing their health. It integrates speech recognition, language detection, medical condition assessment, and real-time text-to-speech generation, providing a seamless, conversational experience for users.

This project is designed to detect symptoms based on user voice input and provide tailored advice in different languages. The assistant can also check common medical conditions and generate responses using the AIML API with an embedded AI model.

Key Features

• Voice-to-Text Conversion: Translates user speech into text using Google SpeechRecognition.
• Multilingual Support: Detects the language of the input text and provides responses in the detected language or the user's preferred language.
• Medical Condition Checker: Checks user-reported symptoms against a mock medical database for common conditions (e.g., fever, headache).
• AI-Powered Responses: Utilizes the AIML API to generate AI responses based on the user's symptoms and health conditions.
• Text-to-Speech: Converts AI-generated text responses back into audio and plays it for the user in real-time.
• Audio Control: Allows users to control audio playback, stop, repeat responses, and seek backward in the audio.
• User Profile Management: Customizes responses based on the user's age, weight, and language preferences.

Technologies Used

1. SpeechRecognition: Used for converting audio to text.
2. gTTS (Google Text-to-Speech): Converts text responses to speech.
3. OpenAI AIML API: Provides AI-based responses based on user queries and health conditions.
4. Langdetect: Automatically detects the language of the input text.
5. Sounddevice & Pydub: For playing back audio responses.
6. Streamlit: Used to create an interactive web-based user interface.

Industry Impact

• Healthcare Support: The project acts as a virtual assistant for users to get basic health information and guidance in multiple languages. It can be a valuable tool for first-line support and monitoring.
• : By supporting a wide range of languages, it can assist non-English-speaking users, which is vital in areas with linguistic diversity.