The Deaf and Dumb people find it very difficult to express their feelings to normal people since the normal people lack the knowledge of the Sign language used by the deaf and dumb people. Thus the development of a system to bridge the gap of communication between the hearing impaired/mute people and the normal people who are well able to speak and hear would be of great utility to the society. The conception of the system that would be able to interpret the signs used by the deaf and the mute would facilitate the understanding of the Sign Language to the common people. With the aid of such a system the interpretation of the signs portrayed by the deaf or a dumb person would be converted into text which is well understood by normal people. Thus such a system would eliminate the dependency of common people over the Translators to understand the Sign Language.