Published January 1, 2026 | Version v1

Real-Time Bidirectional Speech Translation With Automated Note Generation: A Hybrid Approach Using Whisper AI And Neural Machine Translation

Description

This paper presents a novel web-based system for real-time bidirectional speech translation coupled with automated note generation. The system integrates OpenAI\\\'s Whisper for offline speech recognition, Google Translate API for neural machine translation, and a React-based frontend for user interaction. Unlike conventional translation systems, our approach includes intelligent text analysis for action item extraction, question detection, and contextual memory to maintain translation coherence across conversation segments. The system achieves an average transcription accuracy of 94% with Whisper\\\'s small model and provides sub-2-second latency for real-time translation. Experimental results demonstrate the system\\\'s effectiveness in educational settings, business meetings, and cross-cultural communication scenarios.

Files

IJSET_V14_issue1_156.pdf

Files (657.1 kB)

Name Size
md5:8a16104e89785e398bbb8049be1d60a0
657.1 kB Preview Download

Additional details