HEARLINK_FRONTEND_NEW

🔊 HearLink: Bridging Silence, Building Futures

Empowering Deaf, Hard-of-Hearing & Neurodiverse Students with Real-Time AI Support. HearLink is a cloud-native, production-ready EdTech solution that transforms classrooms into inclusive learning spaces using multilingual speech-to-text, emotion detection, and AI-generated learning aids.

🚀 Top 83 Project - Pragati META AI Hackathon 2025

---

🌐 Live Deployment & Repos

Resource	Link
🖥️ Live Web App	Try HearLink Now
🌍 Main Repository	GitHub - HearLink Main
📽️ Pitch Deck	View Pitch Deck
Live prototype Video	Video

---

🌟 Core Features

Feature	Description
🎤 Real-Time Multilingual Speech-to-Text	Converts classroom speech into real-time captions across 50+ languages using fine-tuned Whisper models.
😊 Emotion Detection (Live)	Uses camera-based AI to detect student emotions like confusion, frustration, and boredom. Sends alerts to teachers.
📚 AI-Generated Study Materials	Transcribes lectures to generate notes, quizzes, flashcards, and summaries in multiple languages via Ollama.
🧠 Teacher Decision Support	Real-time analytics on student engagement. Suggests minor/major interventions based on detected emotion levels.
💻 Device-Agnostic Access	Web-based platform works on laptops, tablets; mobile version in development.
📈 Feedback & Reports	Dashboards for teachers show individual student progress and emotional engagement history.

---

🚧 Future Roadmap

Upcoming Feature	Description
🧑‍🏫 Full-Class Emotion Analytics	Group emotion tracking and class-wide participation dashboards.
📱 Mobile App	Cross-platform Flutter app to support smartphones and at-home learners.
💡 Smart Assistive Hardware	Affordable wearable or classroom devices for deaf students.
🔗 EdTech Integration	Plug-and-play API support for Google Classroom, Moodle, Microsoft Teams.

---

🧪 Technology Stack

Component	Tech
Speech-to-Text	Whisper (fine-tuned), E2E Cloud
Emotion Detection	Custom FER model
AI/LLM	Ollama, Gemini for teacher insights
Frontend	React (Web), Flutter (Mobile)
Backend	Flask
Database	PostgreSQL, S3-compatible object storage
Analytics	Superset, Metabase
Demo/UI	Streamlit (initial versions)

---

💼 Business & Social Impact Strategy

Strategy	Model
B2B SaaS	Subscription tiers: Basic, Pro, Enterprise
B2G	Government partnerships for wide rollout
D2C (Coming)	Paid app for learners + parent dashboards
CSR & NGOs	Affordable deployment in underserved schools
Ethical Data Insights	Anonymized, compliant reports for policy makers

---

📊 Scalability & Infrastructure

• Hosted on: E2E Networks (cost-efficient, India-optimized)
• Cloud-native: Horizontal scaling, serverless options
• Edge-Optimized: Future-ready for on-device emotion analysis
• Regionally Tuned Models: Support for local dialects and accents
• API-First Architecture: Simple integration with any LMS or EdTech system

---

🏆 Why HearLink is Unique

✅ Production-Ready – Already operational in classrooms

✅ Inclusive Design – Deaf, neurodiverse, and multilingual students supported

✅ Multi-AI Fusion – Speech, Vision, and NLP blended seamlessly

✅ Scalable & Sustainable – Tiered business model, affordable for public schools

✅ Impact-Oriented – Real feedback, real use cases, real change

---

✨ Recognition

🎖️ Selected in Top 83 Projects at META AI Pragati Hackathon 2025, India’s premier AI innovation event supporting real-world problem solving in education.

---

🤝 Contact & Collaboration

📬 Email: maitras600@gmail.com

👥 Team HearLink Members

Swarnojit Maitra (Team Leader)

Priyadeep Mullick

Titiksha Chakraborty

Arpan Chowdhury

📣 We're open to partnerships with schools, NGOs, EdTech firms, and government bodies.