This project focuses on working on an algorithm to create a sign language recognition model. This model aims at improving the communication process between deaf people and people who don’t understand sign language. In addition to the 26 letters, the approach uses image data for space and delete gestures as well. The result showed around 96% accuracy in case of high resolution images and about 98% after applying the 5 layer CNN.