BISINDO Recognition

An Artificial Intelligence that doing Recognition to Indonesian Sign Languange (Bisindo)

Our Research

Indonesian Sign Language Recognition

Indonesian Sign Language (Bisindo) Recognition powered by Artificial Intelligence: Our cutting-edge technology understands and interprets the rich and expressive world of Indonesian Sign Language, enabling seamless communication between the Deaf and hearing communities. Unlocking new avenues for inclusive and accessible communication through the power of AI.

Image

Architecture

ResNet-50 + LSTM

The first model architecture is built with a combination of ResNet-50 and Long Short-Term Memory (LSTM), where ResNet-50 functions to perform feature extraction on video data, and LSTM processes the sequence of the video data. The architecture of the LSTM used can be seen in the following figure.

LSTM
Convolutional LSTM

The second model architecture is built using the Convolutional LSTM method, where the preprocessed video data, without using ResNet-50, produces an output in the form of images. The data is then sent to the Convolutional LSTM for convolution processing and handling of the data sequence. The architecture of the Convolutional LSTM used can be seen in the following figure.

LSTM

ResNet-50 + LSTM

Upload a Video to Predict

Prediction Result



Convolutional LSTM

Upload a Video to Predict

Prediction Result


Realtime Prediction

Prediction Result


Loading...