Published January 1, 2026 | Version v1

Argus: A Game-Agnostic Accessibility Overlay for Visually Impaired Players

Authors/Creators

Description

More than 2.2 billion people globally live with near or distance vision impairment, yet video game accessibility depends almost entirely on per-game effort: studios that do not invest in built-in features leave their titles permanently unreachable, and community-made accessibility mods, though valuable, are confined to games that expose a modding API. We present Argus, a game-agnostic accessibility overlay that delivers real-time spoken narration for any video game without game-side modification or developer cooperation, operating solely on the rendered screen output. Argus captures the live game window, segments UI regions using open-vocabulary prompts (SAM~3), extracts text via OCR, and synthesises context-aware guidance through a local LLM and neural TTS engine---a pipeline that generalises across art styles without per-title training data. We demonstrate Argus on tutorial gameplay from and , two visually and mechanically distinct titles, confirming that the same prompt vocabulary transfers across both rendering styles without reconfiguration.

Files

2026-Argus_Game_Agnostic_Accessibility_Overlay.pdf

Files (467.3 kB)