Published January 8, 2026
| Version v1
Journal article
Open
Psychometric validation of a culturally adapted medication literacy questionnaire in Indonesian communities: evidence from EFA and Rasch modeling
Authors/Creators
- 1. Department of Pharmacy, STIFAR Riau, Pekanbaru, Indonesia
- 2. Universitas Muhammadiyah Magelang, Magelang, Indonesia
- 3. Universitas Islam Sultan Agung, Semarang, Indonesia
Description
Introduction: Medication literacy describes a crucial determinant of patient safety and rational medicine use, influencing an individual's ability to interpret instructions, avoid errors, and adhere to treatment. In Indonesia, where self-medication practices are widespread and health literacy remains uneven, no validated instrument exists to assess medication literacy. The objective of this study was to evaluate the validity and reliability of a newly developed Indonesian Medication Literacy Questionnaire using Exploratory Factor Analysis (EFA) and Rasch model approaches.
Methods: A cross-sectional survey was conducted among 289 community respondents in Riau Province. The questionnaire was developed through expert panel review and pilot testing, yielding 30 initial items across four domains. Psychometric evaluation involved two stages: (1) EFA to determine factor structure, supported by the Kaiser–Meyer–Olkin measure and Bartlett's test, factor loadings, Average Variance Extracted (AVE), and Cronbach's alpha for reliability; (2) Rasch analysis to assess item fit, person and item reliability, separation indices, and Wright map distributions. Ethical approval was obtained from the institutional review board.
Results: EFA retained 17 items forming four factors, supported by high sampling adequacy (KMO = 0.948; Bartlett's χ² = 6013.7, p < 0.001). All factors demonstrated satisfactory convergent validity (AVE > 0.50) and internal consistency (Cronbach's α > 0.80). Rasch analysis confirmed robust measurement properties, with item reliability = 0.97, person reliability = 0.90, and separation indices exceeding 3. Item difficulty distribution was balanced, supporting discriminatory power across respondent ability levels.
Conclusion: The Indonesian Medication Literacy Questionnaire demonstrated strong validity and reliability. This culturally adapted tool can be applied in research, education, and public health interventions to improve medication safety in Indonesia.
Files
PHAR_article_176368.pdf
Files
(1.3 MB)
| Name | Size | Download all |
|---|---|---|
|
md5:1860110f2e04f13885e65698b926c2bc
|
1.2 MB | Preview Download |
|
md5:39d25fcb631dcc2ab4003af6b2fb97e5
|
105.1 kB | Preview Download |
Additional details
References
- Barreto MAF, Negreiros FDS, Cestari VRF, Sampaio HAC, Moreira TMM (2024) Evidence of validity of the Risk Self-Medication Questionnaire focused on health literacy. Revista Brasileira de Enfermagem 77(3): e20230386. https://doi.org/10.1590/0034-7167-2023-0386
- Bentler PM (1990) Comparative fit indexes in structural models. Psychological Bulletin 107(2): 238–246. https://doi.org/10.1037/0033-2909.107.2.238
- Bond T (2015) Applying the Rasch model: Fundamental measurement in the human sciences. Routledge, 3rd edn., 406 pp. https://doi.org/10.4324/9781315814698
- Du W, Alias BS, Wahab JLA (2025) Ensuring accuracy: Calculating the content validity index for teacher job satisfaction surveys among Henan private universities in China. Journal of Posthumanism 5(3): 391–408. https://doi.org/10.63332/joph.v5i3.745
- Field AP (2018) Discovering statistics using IBM SPSS statistics, 5th edn. Sage.
- Finbråten HS, Kleppang AL, Steigen AM (2021) Using the Rasch measurement theory to assess the psychometric properties of the Hopkins Symptom Checklist-10 in adolescents. Health and Quality of Life Outcomes 19: 248. https://doi.org/10.1186/s12955-021-01884-9
- Gentizon J, Hirt J, Jaques C, Lang P, Mabire C (2020) Instruments assessing medication literacy in adult recipients of care: A systematic review of measurement properties. International Journal of Nursing Studies 113: 103785. https://doi.org/10.1016/j.ijnurstu.2020.103785
- Hair JF, Black WC, Babin BJ, Anderson RE (2019) Multivariate data analysis, 8th edn. Cengage.
- Hajji J, Baaziz M, Mnedla S, Jannet ZB, Elloumi A (2016) Validation of the Arabic version of the Inventory of Coping Strategies of Competitive Sport (ISCCS). Advances in Physical Education 6(4): 312–327. https://doi.org/10.4236/ape.2016.64032
- Hayton JC, Allen DG, Scarpello V (2004) Factor retention decisions in exploratory factor analysis: A tutorial on parallel analysis. Organizational Research Methods 7(2): 191–205. https://doi.org/10.1177/1094428104263675
- Hu L, Bentler PM (1999) Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal 6(1): 1–55. https://doi.org/10.1080/10705519909540118
- Ingchatcharoen S, Tangdhanakanond K, Pasiphol S (2016) Testing measurement invariance of quality rating causal models in tutorial-based assessment. Procedia Social and Behavioral Sciences 217: 867–877. https://doi.org/10.1016/j.sbspro.2016.02.018
- Kusuma IY, Bahar MA, Nuari DA, Prabandari R, Soeharto S, Csupor D, Benkő R, Matuz M (2024) Antibiotic knowledge assessment questionnaire in undergraduate pharmacy students: A Rasch analysis of validity evidence. Pharmacy Education 24(1): 54–78. https://doi.org/10.46542/pe.2024.241.5478
- Maskey R, Fei J, Nguyen H-O (2018) Use of exploratory factor analysis in maritime research. The Asian Journal of Shipping and Logistics 34(2): 91–111. https://doi.org/10.1016/j.ajsl.2018.06.006
- Modern psychometrics (n.d.) The science of psychological assessment. ResearchGate.
- Morgado FFR, Meireles JFF, Neves CM, Amaral ACS, Ferreira MEC (2017) Scale development: Ten main limitations and recommendations to improve future research practices. Psicologia, Reflexão e Crítica [Revista Semestral Do Departamento de Psicologia Da UFRGS] 30: 3. https://doi.org/10.1186/s41155-016-0057-1
- Mustafa NK, Ibrahim R, Awang Z, Aizuddin AN, Syed Junid SMA (2024) Validation of a quantitative instrument measuring critical success factors and acceptance of Casemix system implementation in the total hospital information system in Malaysia. BMJ Open 14(8): e082547. https://doi.org/10.1136/bmjopen-2023-082547
- Nunnally JC, Bernstein IH (1994) Psychometric theory. McGraw-Hill Companies.
- Okuyan B, Atasoy B, Kulak E, Gorpuz G, Sancar M, Ay P (2025) Development and validation of medication literacy scale for adults: MELSA version II. BMC Public Health 25(1): 987. https://doi.org/10.1186/s12889-025-22200-w
- Huang L, Wei F, Liu Y, Xu J, Wu J, Wang Q, Wang S, Wu W (2025) Measuring the medication literacy level of community residents: A cross-sectional study. Frontiers in Public Health 13: 1605296. https://doi.org/10.3389/fpubh.2025.1605296
- Jhantasana C (2023) Should a rule of thumb be used to calculate PLS-SEM sample size. Asia Social Issues 16(5): e254658. https://doi.org/10.48048/asi.2023.254658
- Phanniphong K, Na-Nan K (2025) Development and validation of a factor analysis-validated comprehensive scale for measuring innovative work behavior. Sustainable Futures 9: 100704. https://doi.org/10.1016/j.sftr.2025.100704
- Pouliot A, Vaillancourt R, Stacey D, Suter P (2017) Defining and identifying concepts of medication literacy: An international perspective. Research in Social and Administrative Pharmacy 14: 797–804. https://doi.org/10.1016/j.sapharm.2017.11.005
- Rahman FI, Aziz F, Huque S, Ether SA (2020) Medication understanding and health literacy among patients with multiple chronic conditions: A study conducted in Bangladesh. Journal of Public Health Research 9(1): 1792. https://doi.org/10.4081/jphr.2020.1792
- Rand S, Towers AM, Allan S, Webster L, Palmer S, Carroll R, Gordon A, Akdur G, Goodman C (2024) Exploratory factor analysis and Rasch analysis to assess the structural validity of the Adult Social Care Outcomes Toolkit Proxy version (ASCOT-Proxy) completed by care home staff. Quality of Life Research 33(6): 1555–1567. https://doi.org/10.1007/s11136-024-03631-1
- Sawkin MT, Deppe SJ, Thelen J, Stoner SC, Dietz CA, Rasu RS (2015) Health literacy and medication adherence among patients treated in a free health clinic: A pilot study. Health Services Research and Managerial Epidemiology 2: 1–7. https://doi.org/10.1177/2333392815589094
- Schillinger D (2021) Social determinants, health literacy, and disparities: Intersections and controversies. HLRP Health Literacy Research and Practice 5(3): e234–e243. https://doi.org/10.3928/24748307-20210712-01
- Shi J, Qi L, Li Y, Liu X (2020) Investigation of health literacy status in Beijing, China. HLRP Health Literacy Research and Practice 4(3): e174–e184. https://doi.org/10.3928/24748307-20200731-01
- Sudhakar SK, Doshi DP, Nair G, Rao T (2025) Investigating health literacy and sociodemographic factors in college students. Scientific Reports 15: 20455. https://doi.org/10.1038/s41598-025-04389-3
- Sulistyaningrum IH, Sarosa H, Arfianto E, Pribadi P (2025) Development and initial valida-tion of the antibiotic use behavior assessment questionnaire based on the COM-B model among university students. Pharmacia 72: 1–10. https://doi.org/10.3897/pharmacia.72.e169411
- Tabachnick B (2019) Using multivariate statistics, 7th edn. Pearson.
- Tedy C (2019) The influence of service quality, university image on student satisfaction and student loyalty. Benchmarking An International Journal 26(5): 1533–1549. https://doi.org/10.1108/BIJ-07-2018-0212
- Tennant A, Conaghan PG (2007) The Rasch measurement model in rheumatology: What is it and why use it? When should it be applied, and what should one look for in a Rasch paper? Arthritis and Rheumatism 57(8): 1358–1362. https://doi.org/10.1002/art.23108
- Wardani RT, Nuraeni E, Diana S (2025) Rasch model analysis of essay questions to measure literacy and numeracy skills in plant and animal bioprocess topics based on AKM. REID Research and Evaluation in Education 11(1): 29–44. https://doi.org/10.21831/reid.v11i1.85614
- Wilkinson K, Shapiro C (2013) Development and validation of the Nonrestorative Sleep Scale (NRSS). Journal of Clinical Sleep Medicine 9(9): 929–937. https://doi.org/10.5664/jcsm.2996
- Wilkinson K, Shapiro C (2013) Development and validation of the Nonrestorative Sleep Scale (NRSS). Journal of Clinical Sleep Medicine 9(9): 929–937. https://doi.org/10.5664/jcsm.2996
- Wu X, Cai S, Zhou Y, Lan Y, Lin Y (2024) Development, reliability and validity of the Medication Literacy Scale for parents of children with epilepsy. Patient Preference and Adherence 18: 165–176. https://doi.org/10.2147/PPA.S446081
- Wulandari P, Aziza YN, Ghozali M, Laksitorini M, Endarti D (2025) Pharmacists' and community knowledge on the safety and halal status of pediatric medications containing alcohol. Indonesian Journal of Pharmacy 187–195. https://doi.org/10.22146/ijp.11656