Educational meetings are an essential tool for knowledge sharing and learning. These meetings are typically conducted in a single language, often English, which can pose a significant barrier to individuals who are not fluent in the language used. This can result in a significant portion of the population being left out of important discussions and knowledge sharing. Similarly, individuals with hearing impairments face significant barriers in accessing educational meetings as they rely on sign language interpreters or captioning to understand the content of the meeting. This can lead to a lack of inclusivity and equity in learning environments.
Our project aims to address this problem by developing an application that caters to the needs of individuals with diverse linguistic and hearing abilities. Our application will provide three different modes of accessing educational meetings. Firstly, it will cater to individuals who understand the language used in the meeting. Secondly, it will provide a text-to-text translation feature for individuals who want to listen to the meeting in their mother tongue. Lastly, it will cater to deaf individuals by converting text to sign language phrases and rendering them with 3D avatars along with the visuals of the meeting.
Our application will provide a user-friendly interface that allows individuals to select the mode that suits them best. The application will also provide features such as live captioning, which will ensure that individuals can follow along with the meeting even if they miss a few words. Additionally, the application will allow individuals to save transcripts of the meeting, which they can refer to later for study or reference purposes. This application will bridge the language and hearing gaps, ensuring that everyone can access education and knowledge sharing, regardless of their linguistic or hearing abilities. Our project will promote equal access to education and knowledge sharing, ensuring that no one is left out of important discussions and knowledge sharing.
A meeting app specifically an education platform that facilitates online meetings, video conferences, and webinars. Featuring gesture recognition for the dumb and deaf for bridging the gap of communication and enabling active participation of people from all walks of life.
WEB SCOPE :
-
Scheduling: The ability to schedule meetings, invite participants, and send out reminders.
-
Video Conferencing: The ability to connect participants through audio and video channels in real-time.
-
Screen Sharing: The ability to share screens, presentations, or documents during the meeting.
-
File Sharing: The ability to share files, documents, or presentations during the meeting.
-
File-Sharing: The ability to share downloaded videos, process it, convert into gestures for especially abled users.
ML SCOPE :
-
Speech Recognition: The ability to recognise and interpret spoken words and phrases accurately.
-
Gesture Recognition: The ability to recognise and interpret hand gestures or body movements accurately.
-
Natural Language Processing (NLP): The ability to analyse the context and meaning of spoken words and phrases and converting it gesture.
-
Predefined Gesture Library: The ability to provide a library of predefined gestures for common commands or actions.
-
Real-Time Feedback: The ability to provide real-time feedback to users on the accuracy and effectiveness of their gestures.
-
Training Mode: The ability to provide a training mode for users to practice and improve their gestures.
-
Accessibility: The ability to provide accessibility features such as voice commands or text-to-speech capabilities.
AVATAR :
-
Avatar Creation: The ability to create a new avatar from scratch or select from a library of pre-existing characters.
-
Customisation: The ability to customise various aspects of the avatar, such as facial features, hair, skin tone, clothing, accessories, and animations.
-
Realistic or Cartoonish: The ability to choose between realistic or cartoonish designs for the avatar.
-
Rendering and Integration: Rendering the Avatar to ML model and integrating extracted gesture features from the model.
Welcome to our project team! We are a group of five college students who are passionate about solving real-world problems through project-based learning (PBL). Our team is composed of individuals with diverse backgrounds, skill sets, and experiences, but we are united by our shared goal of creating innovative solutions that can make a positive impact on our community.
Let us introduce ourselves :
Together, we are a dynamic and collaborative team that believes in the power of PBL to drive learning, creativity, and innovation. We are excited to embark on this project and look forward to sharing our progress with you. Thank you for your support!