No news is good news testing modality and redundancy in immersive augmented reality

Background

The modality and redundancy principles are well-established within the cognitive theory of multimedia learning for their effectiveness in traditional media. However, previous studies applying these principles in virtual reality have shown contradictory results when immersive technologies are involved.

Objectives

This study investigates the effects of modality and redundancy principles from the cognitive theory of multimedia learning on cognitive load and learning outcomes in head-mounted display augmented reality.

Methods

Using a between-subjects experimental design, 104 male participants were randomly assigned to three conditions based on the way verbal instructions related to a T-shirt folding procedure were presented (audio-only, text-only, text-and-audio). The presentation of the verbal instructions served as the manipulated variable; cognitive load levels and participants' performance were measured as outcome variables. Bayesian analyses were conducted to verify that there were no significant differences between the text-and-audio group and the audio-only group, and a Partial Least Squares Structural Equation Model (PLS-SEM) examined the relationship between the experimental condition, cognitive load levels, and participants' performance.

Results and Conclusions

Results support the validity of the modality principle in head-mounted display augmented reality, showing that applying the modality principle significantly decreases intrinsic cognitive load and improves learning performances. The null hypothesis was supported by comparing audio-only and text-and-audio conditions for both cognitive load and learning outcomes. These findings suggest that cognitive theory of multimedia learning principles work similarly in head-mounted display augmented reality as in traditional media, and they offer valuable insights into multimedia learning in immersive augmented reality, extending our understanding of how these principles function in immersive technologies. Contradicting results using immersive technologies could be explained by considering task complexity and perceived intrinsic cognitive load; however, further studies testing different learning materials are necessary to support this hypothesis.

• What is currently known about this topic

  • 
    

    Augmented Reality (AR) enhances learning over traditional methods; meta-analyses show significant effects.

  • 
    

    AR's impact on cognitive load (CL) varies by task type, with procedural tasks lowering CL more than declarative tasks.

  • 
    

    The Cognitive Theory of Multimedia Learning (CTML) outlines principles to optimise CL (e.g., modality, redundancy).

  • 
    

    Limited studies address how CTML principles apply to AR via Head-Mounted Displays (HMD-AR).

   

• What this paper adds

  • 
    

    This study examines the modality principle and redundancy principle in HMD-AR for procedural learning.

  • 
    

    Redundancy did not harm outcomes.

  • 
    

    Modality was confirmed: audio-only and audio + text yielded better performance than text-only.

  • 
    

    The reversed modality principle effect found in virtual reality studies may be due to the high levels of perceived intrinsic CL in the selected tasks.

   

• Implications for practise and/or policy

  • 
    

    Designers should favour audio narration over text to reduce load and improve efficiency in HMD-AR.

  • 
    

    Educators using HMD-AR should align materials with multimedia principles, not assuming redundancy impairs outcomes.

  • 
    

    AR developers should apply CTML principles in their applications.

  • 
    

    Policymakers integrating HMD-AR must consider CLT and CTML for efficient cognitive processing.