URVOICE: AN AKL-TOUSSAINT/ GRAHAM-SKLANSKY APPROACH TOWARDS CONVEX HULL COMPUTATION FOR SIGN LANGUAGE INTERPRETA-TION

Abstract

We present URVoice, a vocalizer for the communication impaired, based on the Indian Sign Language Notations. Contemporary psychological theories consider language and speech as devices to understand complex psychological processes and deliver them as cultural products of ideas and communication. Sign and gesture language, offering an intelligent co-ordination of eye-and-hand and ear-andmouth, has evolved as an intelligent manifestation of speech for the impaired. However, they have very limited modality and iconicity in accommodating a greater range of linguistically relevant meanings. URVoice is an Augmentative and Alternative Communication (AAC) device, which currently features a pipeline of forward communication from signer to collocutor with a novel approach shouldered on convex hull using vision based approach. The solution achieves real time translation of gesture to text/voice using convex hull as the computational geometry, which follows Akl-Toussaint heuristic and Graham-Sklansky scan algorithms. The results are weighed against our other solutions based on conventional Machine Learning and Deep Learning approaches. A futuristic version of URVoice, with voice translated to sign language gestures, will be a complete solution for effectively bridging the cognitive and communication gap between the impaired and the abled lot.

1. INTRODUCTION

The truism of language and scientific linguistics emerged from man's reinforcing vocal behaviour as a response to the evolving social and natural circumstances. The human species grew to evolve as the singular evolutionary group with a unique neurological organization to support language. Speech and language, that started off as a mapping of meanings to sounds, has now grown to mapping of complex representational intelligence to complicated cognitive communication systems. They have further succeeded in understanding the structural compositions of language in terms of underlying mental expressions. A communication disorder in human information processing system adversely affects a person's ability to talk, understand, read, and write. Individuals with speech and language impairments lack sufficient representational and communication intelligence and leave them with very less choice to express the forbiddingly abstract levels of subtilities in human communication. Speech and language impairments are considered a high-incidence disability BrainFacts (2012) Francisco (2017) Yukiko & Kiyoshi (2004) . Sign and gesture language, attributed to an intelligent co-ordination of eye-and-hand and ear-andmouth, evolved as an intelligent manifestation of speech for the impaired. There is no universal sign language used around the world. There are about 138 to 300 different types of sign languages used around the globe todayRichard (2018). A few most widely used sign languages are discussed in detail in Table A1 . However, they have very limited modality and iconicity in accommodating a greater range of linguistically relevant meanings. They also fail to cover the verbal spectrum of temporal and spacial

