Sign language is an optical communication language used by the people with speech and hearing disabilities for communication in their day-to-day conversation. Sign Language Recognition (SLR) system, which is required to recognize sign languages, has been widely studied for the past few years. Several input sensors, gesture segmentation, feature extraction and classification methods were used for the study. To eliminate the barrier in the communication between abled and disabled people is the main aim of this paper. This paper proposes a method to translate ASL in real time by mobile camera such that it can serve as a conversation medium between normal and deaf/dumb people.