sign_lang_detection

This project is built to help read and interprete sign languages of India. We are using an LSTM & DENSE model as base.

Technologies used

Codes are in the src folder.
to run the project run the output.py file in src or simply the run.sh in the base directory

All the python codes in the src directory are used for:

mediapipe_processing.py : operations of mediapipe module on a perticular frame and generating final numpy file for model
train_data_gen.py : to capture video data for every action such as 'thanks', 'hello', etc. and saving them in data directory
model_base.py : this file contains the LSTM, DENSE model which is in form of a class with 2 member functions train_model() & pretrained_model().
output.py : this is the final file which shows the output that is the sign language detection [NOTE: to use pretrained_model() there must be the action.h5 file present in base directory]