Skip to content

Computer vision

Real-time sign language detection

Custom SSD object detector

Timeline
Apr 2021 to Oct 2021
Affiliation
Independent project
Architecture
SSD

What it is

An end-to-end custom object-detection system that recognizes hand gestures and translates sign language into text in real time for people with hearing impairments.

Problem

Communication barriers for users of sign language in everyday settings.

Approach

Trained a Single Shot Multibox Detector in TensorFlow on a custom gesture dataset and integrated it with a live camera feed.

Highlights

  1. Accurate real-time detection and translation of multiple gestures.