Skip to content

About

Real-time Emotion Detection system using Face & Voice AI with an intelligent assistant, analytics dashboard, and mood-based responses. Combines computer vision, audio processing, and machine learning to detect human emotions and provide interactive, real-time feedback.

Topics

Resources

Stars

1 star

Watchers

0 watching

Forks

Latest commit

 

History

2 Commits

Folders and files

Repository files navigation

🧠 Emotion-AI

🚀 Real-time Emotion Detection System using Face + Voice AI with an intelligent assistant, analytics dashboard, and mood-based responses.


📌 Overview

Emotion-AI is a multi-modal AI system that detects human emotions using:

  • 📷 Facial expressions (Computer Vision)
  • 🎤 Voice signals (Audio Processing)

It combines both to generate:

  • 🤖 Smart assistant responses
  • 🎵 Mood-based music suggestions
  • 📊 Real-time emotion analytics

🚀 Features

  • 🎭 Face Emotion Detection

    • Deep learning model using DeepFace
    • Real-time webcam processing
  • 🎙️ Voice Emotion Recognition

    • Audio feature extraction (MFCC, etc.)
    • ML-based classification
  • 🤖 AI Assistant

    • Emotion-aware responses
    • Text-to-Speech output
  • 🎵 Music Recommendation

    • Plays songs based on detected mood
  • 📊 Analytics Dashboard

    • Emotion trends
    • Visualization of mood patterns
  • ⚡ Real-time Processing

    • Live face + voice detection

🛠️ Tech Stack

Category Technologies Used
Programming Python
Computer Vision OpenCV, DeepFace
Machine Learning Scikit-learn
Deep Learning TensorFlow / Keras
Audio Processing Librosa, SoundDevice
Speech Recognition SpeechRecognition
Text-to-Speech pyttsx3
Visualization Matplotlib, Seaborn
UI / Dashboard Streamlit
Assistant API OpenAI (optional)

📂 Project Structure

Emotion-AI/ │ ├── modules/ # Core logic (AI + assistant + audio) ├── training/ # Model training scripts ├── utils/ # Helper functions & analytics │ ├── main.py # Main entry point ├── run_dashboard.py # Streamlit dashboard ├── requirements.txt # Dependencies ├── .gitignore # Ignored files


⚙️ Installation

1️⃣ Clone the repository

git clone https://github.com/krishbaloria11/Emotion-AI.git
cd Emotion-AI

⚙️ Installation & Usage

1️⃣ Install dependencies

pip install -r requirements.txt

2️⃣ Run the project

python main.py


3️⃣ Run dashboard (optional)

streamlit run run_dashboard.py 📊 Dataset

This project uses:

FER2013 → Face Emotion Dataset RAVDESS → Voice Emotion Dataset

⚠️ Datasets are not included due to size and licensing restrictions.


🎯 Model Performance Model Type Accuracy Face Model ~65–70% Voice Model ~80–85%


🔐 Privacy & Security

❌ No user data is stored ❌ No images or videos are saved 🎤 Audio is processed in real-time 📷 Webcam feed is not recorded 🌐 Voice recognition may use external APIs (Google Speech API)


⚠️ Notes

Ensure microphone and webcam permissions are enabled Some features may require internet (speech recognition) OpenAI integration is optional and disabled by default


🔮 Future Improvements

🌐 Web App Deployment (Streamlit / Flask) 📱 Mobile Application 🎯 Improved accuracy (90%+) ☁️ Cloud-based inference 🧠 Emotion history tracking


🤝 Contributing

Contributions are welcome! Feel free to fork the repo and submit a pull request.


⭐ Support

If you like this project:

👉 Give it a STAR ⭐ on GitHub 👉 Share it with others


👨‍💻 Author

Krish Baloria GitHub: https://github.com/krishbaloria11

Jatin Github: https://github.com/Jatin-Verma11


📜 License

This project is for educational purposes.

About

Real-time Emotion Detection system using Face & Voice AI with an intelligent assistant, analytics dashboard, and mood-based responses. Combines computer vision, audio processing, and machine learning to detect human emotions and provide interactive, real-time feedback.

Topics

Resources

Stars

1 star

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages