TY - GEN
T1 - When Sign Language Meets Semantic Communications
AU - Kouvakis, Vasileios
AU - Trevlakis, Stylianos E.
AU - Boulogeorgos, Alexandros Apostolos A.
AU - Tsiftsis, Theodoros
AU - Singh, Keshav
AU - Qi, Nan
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - This paper presents an American sign language (ASL) semantic communications scheme. The scheme consists of a semantic encoder that leverages a convolutional neural network to effectively utilize the ASL alphabet. The encoded information is transmitted with the 24-QAM quadrature amplitude modulation (QAM). Additionally, this paper introduces a dataset that involves the overlaying of red-green-blue landmarks and key-points onto the acquired images, thereby augmenting the depiction of hand posture. The quantification of the proposed system's training, testing, and communication performance is accomplished through numerical results, which serve to emphasize the attainable benefits and stimulate meaningful discussions.
AB - This paper presents an American sign language (ASL) semantic communications scheme. The scheme consists of a semantic encoder that leverages a convolutional neural network to effectively utilize the ASL alphabet. The encoded information is transmitted with the 24-QAM quadrature amplitude modulation (QAM). Additionally, this paper introduces a dataset that involves the overlaying of red-green-blue landmarks and key-points onto the acquired images, thereby augmenting the depiction of hand posture. The quantification of the proposed system's training, testing, and communication performance is accomplished through numerical results, which serve to emphasize the attainable benefits and stimulate meaningful discussions.
KW - American sign language
KW - convolutional neural network
KW - quadrature amplitude modulation
KW - semantic communications
UR - https://www.scopus.com/pages/publications/85215943255
U2 - 10.1109/PIMRC59610.2024.10817453
DO - 10.1109/PIMRC59610.2024.10817453
M3 - Conference contribution
AN - SCOPUS:85215943255
T3 - IEEE International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC
BT - 2024 IEEE 35th International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2024
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 35th IEEE International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2024
Y2 - 2 September 2024 through 5 September 2024
ER -