Published January 1, 2026
| Version v1
Journal article
Open
Real-Time Bidirectional Speech Translation With Automated Note Generation: A Hybrid Approach Using Whisper AI And Neural Machine Translation
Authors/Creators
Description
This paper presents a novel web-based system for real-time bidirectional speech translation coupled with automated note generation. The system integrates OpenAI\\\'s Whisper for offline speech recognition, Google Translate API for neural machine translation, and a React-based frontend for user interaction. Unlike conventional translation systems, our approach includes intelligent text analysis for action item extraction, question detection, and contextual memory to maintain translation coherence across conversation segments. The system achieves an average transcription accuracy of 94% with Whisper\\\'s small model and provides sub-2-second latency for real-time translation. Experimental results demonstrate the system\\\'s effectiveness in educational settings, business meetings, and cross-cultural communication scenarios.
Files
IJSET_V14_issue1_156.pdf
Additional details
Related works
- Has part
- Journal article: https://www.ijset.in/wp-content/uploads/IJSET_V14_issue1_156.pdf (URL)
- Is identical to
- Journal article: https://www.ijset.in/real-time-bidirectional-speech-translation-with-automated-note-generation-a-hybrid-approach-using-whisper-ai-and-neural-machine-translation/ (URL)