Published May 12, 2026 | Version 1.0.0
Software Open

gtheory-app: a Shiny app for generalizability theory analyses

  • 1. Unidade de Educação Médica, Faculdade de Medicina e Ciências Biomédicas, Universidade do Algarve
  • 2. Faculdades Pequeno Príncipe
  • 3. Inspirali Educação
  • 4. European Board of Medical Assessors

Description

Generalizability theory (G-theory) extends classical reliability theory by partitioning measurement error into multiple, separable sources, thereby supporting the design of more dependable measurement procedures. Existing software for G-theory — most notably the GENOVA Suite and EduG — is widely used but predates contemporary R-based reproducible workflows and lacks interactive exploration of decision (D) study trade-offs. We introduce gtheory-app, a free and open-source Shiny application that brings G-theory analysis into the browser. The application accepts long-format data uploads with auto-detected delimiters or score-only files paired with a user-specified design, supports balanced and unbalanced data, and handles fully crossed, nested, and mixed (random + fixed) designs with an arbitrary number of facets. Variance components are estimated via lme4 (REML) with a classical ANOVA cross-check available for balanced data. The application then reports universe-score variance, relative and absolute error variances, the generalizability coefficient (Eρ²), the index of dependability (Φ), Φ(λ) for criterion-referenced decisions, a G-facets sensitivity table, and an interactive 3D surface graph over any pair of user-selected facets with the resulting D-study. Every numerical output is paired with a context-sensitive, plain-language interpretation that names the user's actual facets, places reliability values in conventional bands, and identifies the largest single error term as a target for redesign. We illustrate the application on three classes of designs: a fully crossed three-facet design, a nested-items design, and a multi-facet chain-nested design. We argue that gtheory-app fills a clear gap in the open-source psychometric software ecosystem and lowers the barrier to G-theory for applied researchers, educators, and assessment professionals.

 

Files

g-theory-app-1.0.0.zip

Files (58.6 kB)

Name Size Download all
md5:2d2d6a328ba3af04d12ee698055dac01
58.6 kB Preview Download

Additional details

Dates

Updated
2026-05-12
bug fixes

Software

Programming language
R
Development Status
Active