Unexpressed emotions will die no more!

We at ExpressAbled have an aim of connecting the people with auditory and visual disabilities with the world by implementing various methods to overcome the obstacles of communication.

ExpressAbled

awesome features

fun facts

why us?

We have incorporated 3 autonomous features under one website. We have taken care for precision, accuracy and providing instant output in real-time for every feature, keeping in mind the user-friendly interface for easy access.

Precise

ASL-to-Text

Accurate

Image Captioning

Realtime

Speech-to-Text

3 Things

Under one roof

app screenshots

how it works

1

ASL-to-Text

Live captured images are converted into vectors using pre-trained MobileNet CNN model. This trained dataset is used to predict the new gesture which is done using kNN classification.

2

Image Caption

Images can be provided by users and can be interpreted by using both Convolutional and recurrent neural networks (Resnet50 architecture and LSTM) to give apt captions for the same.

3

Speech-to-Text

The user speaks through a microphone, the device detects the voice and converts it to text using open-source Web Speech API to convert speech to text in real-time.

frequently asked questions

Do I require a special kind of gear/glove for gesture detection?

No, there is no requirement of any additional equipment. You will only require a decent PC/laptop with web camera.

No, there are no specifications on image resolution or dimension, just upload the image in jpg or jpeg or png format.

Speech-to-Text feature uses Web-Speech-API which is not compatible with all browsers. We recommend you to use Google Chrome. For more information, please visit this website.

No, you will need to train your model only when you are using it for the first time. Once created, you can download your dataset. The next time you want to use the same dataset, you can simply upload that .json file and you are good to go!

get in touch

For Any Queries and Support

College

Sardar Patel Institute of Technology, Andheri (W), Mumbai

Write to us at

expressabled@gmail.com

Call us on

+91 9172494383