
Menu

A Global Journal on Intelligent Automation, Mechatronics, Robotics, Engineering, Management, and Sustainable Innovation
ISSN Online: 3155-6019

TechMecha Robosphere
ISSN Online: 3155-6019
Volume 1 | Issue 1 | 2026 | 32 – 44
¹ Student, Pampanga State University, Cabambangan, Bacolor, Pampanga, Philippines
² Associate Professor I, Pampanga State University, Cabambangan, Bacolor, Pampanga, Philippines
³ Assistant Professor IV, Pampanga State University, Cabambangan, Bacolor, Pampanga, Philippines
Article History:
Initial submission: 19 March 2026
First decision: 28 March 2026
Revision received: 08 June 2026
Accepted for publication: 20 June 2026
Online release: 03 July 2026
Ready to submit? Click the button below.
Need more help before you submit?
Communication barriers between deaf, mute individuals and the hearing majority hinder participation in education and daily life. Existing assistive technologies often provide one-way translation, limiting reciprocal interaction and reducing inclusivity. This study developed “Signslator”, a two-way communication system integrating artificial intelligence (AI) and image processing. The prototype utilized a Raspberry Pi 5, camera, microphone, dual monitors, and Python-based software with MediaPipe for gesture recognition. A dataset of 150 school-related words, validated by Special Education (SPED) teachers, was used for training. System performance was tested under controlled conditions with varying confidence thresholds, and evaluated using accuracy, precision, recall, F1-score, and weighted mean ratings from expert feedback. The system achieved 100% accuracy, precision, recall, and F1-score in recognizing letters (A–Z) and numbers (1–9). For the 150-word vocabulary, average recognition accuracy was 84.93%, with 130 words scoring above 50%. However, 20 words fell below 49% accuracy, highlighting limitations in complex or visually similar gestures. Expert evaluation rated the system highly functional (AWM = 4.25), reliable (AWM = 4.21), usable (AWM = 4.55), and efficient (AWM = 4.33). The AI-driven auto-correction feature improved clarity by merging fragmented inputs into coherent words. Findings confirm that “Signslator” effectively bridges communication gaps in classroom settings, enabling real-time two-way translation between spoken language and American Sign Language. While highly accurate for basic gestures, future improvements should expand vocabulary, incorporate facial expressions, and optimize performance under diverse environmental conditions. The system demonstrates strong potential as an inclusive educational tool.
Keywords: Deaf Individuals, Sign Language Translation, Hand Gesture Recognition, Artificial Intelligence in Education, Image Processing, Assistive Technology, Two-Way Communication
APA (7th edition)
Ocampo, L. P., Lucernas, C. J. D., Naquita, J. Z. N., Manabat, L. J. R., Pineda, N. D., Dela Cruz, A. K. S., & Puno, R. R. N. (2026). Signslator: AI and image processing-based two-way translator between verbal communication and sign language. TechMecha RoboSphere, 1(1), 32–43. https://doi.org/10.62718/vmca.tech-robo.1.1.SC-0126-007.
Ruby Rosa N. Puno : Conceptualization, Writing – review and editing, Supervision (Thesis Adviser)
Asil Kastle S. Dela Cruz : Conceptualization, Writing – review and editing, Supervision (Thesis Coordinator)
Leilani P. Ocampo : Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Resources, Software, Validation, Visualization, Writing – original draft
Carriel Justin D. Lucernas : Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Resources, Software, Validation, Visualization, Writing – original draft
John Zenkie N. Naquita : Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Resources, Software, Validation, Visualization, Writing – original draft
Leann Jhiro R. Manabat : Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Resources, Software, Validation, Visualization, Writing – original draft
Nikos D. Pineda : Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Resources, Software, Validation, Visualization, Writing – original draft.
This research received no external funding.
The authors declare no conflict of interest.
In accordance with the ethical standards of the Computer Engineering Department of the Pampanga State University, the protection of participants’ rights and welfare was ensured.
The dataset will be available upon request from the corresponding author of this study.
AI-assisted language editing was performed using ZeroGPT, Gemini and Copilot; authors reviewed and approved all contents. Such measure was pursued for grammar purposes and the restructuring of complex sentence structures. The other parts of the paper maintain full integrity in terms of originality.
The researchers sincerely extend their gratitude to the Pampanga State University for its invaluable support in the conduct of this study. Special appreciation is given to the Pampanga High School for providing guidance and assistance in facilitating the survey among SPED teachers and students. The cooperation of the SPED teachers and students was instrumental in gathering the necessary data and ensuring the integrity of the research process. Their contributions and commitment greatly enriched the findings of this study.
The views expressed in this article are those of the authors and do not necessarily reflect the views of the publisher. The publisher disclaims any responsibility for errors or omissions.