Rudra
- 0 Collaborators
A smart healthcare assistant robot intended for home and hospital use. It is used to interact with the elderly and keep them engaged. This will vastly help uplift their mental health, allow them to keep up with the times while also having someone to reminisce about the olden days with. ...learn more
Project status: Under Development
Robotics, Internet of Things, Artificial Intelligence, Cloud
Overview / Usage
Rudra is a fully voice-operated, completely hands-free system for the elderly, so all they have to do is talk to Rudra to get a job done. The voice assistant has been specially curated according to the needs of the elderly. It performs timely checkups on them, allows them to create reminders for themselves, listen to stories, call up any family members, and have a sympathetic discussion on any topic they desire with the robot. All this is accomplished by employing the following:
- NLP: Natural language processing helps in discerning the tone and context of any spoken sentence, allowing Rudra to have more sympathetic reactions to it. DialogFlow has been used for this purpose.
- Expression-wise response: Rudra continuously monitors the elderly's expressions to further improve the user's experience. This also helps in monitoring their mental health regularly.
- Query response: Several APIs have been used for providing the best one-shop-stop solution for any miscellaneous queries the user might have. The APIs are:
- Meal suggestions and reminders: Physical well-being is equally as important as mental health, therefore, Rudra is designed to timely remind the elderly to drink water, have food, and take any medicines if needed.
- Action Recognition: Computer vision is used to make sure that the elderly have drunk water, had food, and slept properly. The data is only updated in the backend once Rudra detects the above-stated actions and then confirms them with the user to avoid misinterpretation.
Methodology / Approach
Voice Assistance
- Python & Dialogflow
- Sympathetic interaction
- Response according to expression detection and action recognition
- Reminders (meal, water, medicine, etc.)
- Controlling Rudra using voice commands
Human Following
- ESP32, Camera, Compass
- Detects the direction of the recognized face and follows the human
- The advantage in providing all-time surveillance for quick emergency response
Companion App
- Flutter
- For relatives/ caregivers
- Remote monitoring of health and wellbeing
- Remote control accessible
Emergency Monitoring and Reaction
- Camera
- Immediate notification sent to the phone app
Technologies Used
Raspberry Pi 4
Motor Driver
BO Motors + wheel
11.1V 3S 2200mAh LiPo Battery
USB Camera
Micro Servos
Ultrasonic Proximity Sensors
Flutter, Python, Dialogflow, Face Recognition, Voice Assistant, Firebase