“This is an Accepted Manuscript of an article published by Taylor & Francis in Interactive Learning Environments on 2022-06-26, available at: https://doi.org/10.1080/10494820.2022.2091614.”
\nAbstract
\nAssessment is a key element in any course, and providing students with a balance between formative and summative assessments is crucial. Defining such a process is a complex task for teachers and often entails a great workload. This makes it necessary to have tools to help in the assessment process definition and its monitoring. This paper first analyses the possibility of using the available tools in Moodle. For that, we carried out a bibliographical study, conducted semi-structured interviews with 26 teachers, and analysed the use of the Moodle gradebook in their courses. We found that teachers find it quite difficult to use the Moodle gradebook, so they rarely take advantage of all its possibilities. Taking this into account, we present Forge, a system that facilitates the definition of assessment processes following the e2Forja methodology in such a way that the produced process can be exported to Moodle. We have analysed whether Forge makes the assessment definition process easier or not. We have selected four courses to carry out a case study using Forge and interviewed the teachers again. We detected that Forge facilitates the assessment process definition and its monitoring, taking advantage of the characteristics of the Moodle gradebook.
", "languages": [ { "id": "eng", "title": { "en": "English" } } ], "publication_date": "2022-06-26", "publisher": "Taylor & Francis", "references": [ { "reference": "Alvarez, A., & Villama\u00f1e, M. (2019). E2Forja, methodology to define formative continuous assessment and grading processes. In Proceedings of the Seventh International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM'19) (pp. 137\u2013143)." }, { "reference": "\u00c1lvarez-Arana, A., Villama\u00f1e-Giron\u00e9s, M., & Larra\u00f1aga-Olagaray, M. (2020). Improving assessment using visual learning analytics. Education in the Knowledge Society (EKS), 21(0), 13." }, { "reference": "Barrington, R. (2014). Moodle gradebook (2nd ed.). Packt Publishing." }, { "reference": "Carless, D., Bridges, S. M., Chan, C. K. Y., & Glofcheski, R. (eds.). (2017). Scaling up assessment for Learning in higher education (Vol. 5). Springer. https://doi.org/https://doi.org/10.1007/978-981-10-3045-1" }, { "reference": "Cheikh, I. (2020). Exploring the obstacles and challenges of the open-source platform Moodle the case of sciences of the language teachers at Biskra University. http://archives.univ-biskra.dz:80/handle/123456789/16095" }, { "reference": "Custom Grade Formulas in the Moodle Gradebook. (s. f.). https://www.umass.edu/it/support/moodle/custom-grade-formulas-moodle-grade-book" }, { "reference": "Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13(3), 319\u2013340. https://doi.org/https://doi.org/10.2307/249008" }, { "reference": "Fielding, R. T. (2000). Architectural styles and the design of network-based software architectures [Thesis doctoral]. University of California." }, { "reference": "Garc\u00eda-Murillo, G., Novoa-Hern\u00e1ndez, P., & Rodr\u00edguez, R. S. (2020). Technological satisfaction about Moodle in higher education \u2013 A meta-analysis. IEEE Revista Iberoamericana de Tecnologias del Aprendizaje, 15(4), 281\u2013290." }, { "reference": "Gu\u00e0rdia, L., Crisp, G., & Alsina, I.. (2017). Trends and challenges of E-assessment to enhance student learning in higher education. In Innovative Practices for Higher Education Assessment and Measurement (pp. 36\u201356) https://doi.org/https://doi.org/10.4018/978-1-5225-0531-0.ch003" }, { "reference": "Hamodi, C., Pastor, V. M. L., & Pastor, A. T. L. (2015). Medios, t\u00e9cnicas e instrumentos de evaluaci\u00f3n formativa y compartida del aprendizaje en educaci\u00f3n superior (Methods, techniques and tools for formative and shared assessment in higher education). Perfiles Educativos, 37(147), 146\u2013161. https://doi.org/https://doi.org/10.1016/j.pe.2015.10.004" }, { "reference": "Hawking, R. (2017). The utilzation of Moodle in the English language program at J. F. Oberlin University (No. 17; pp. 135\u2013155). J.F. Oberlin University Academic Repository. https://obirin.repo.nii.ac.jp/?action=repository_uri&item_id=2211&file_id=22&file_no=1" }, { "reference": "Ivanovi\u0107, M., Putnik, Z., Komlenov, \u017d, Welzer, T., H\u00f6lbl, M., & Schweighofer, T. (2013). Usability and privacy aspects of Moodle: Students' and teachers' perspective. Informatica, 37(3), Article 3. http://www.informatica.si/index.php/informatica/article/view/451" }, { "reference": "Koretsky, M. D., McColley, C. J., Gugel, J. L., & Ekstedt, T. W. (2022). Aligning classroom assessment with engineering practice: A design-based research study of a two-stage exam with authentic assessment. Journal of Engineering Education, 111(1), 185\u2013213. https://doi.org/https://doi.org/10.1002/jee.20436" }, { "reference": "L\u00f3pez Pastor, V. M. (2009). Una propuesta gen\u00e9rica de evaluaci\u00f3n formativa y compartida para la docencia universitaria. En Evaluaci\u00f3n formativa y compartida en Educaci\u00f3n Superior: Propuestas, t\u00e9cnicas, instrumentos y experiencias (pp. 93\u2013104). Narcea. https://dialnet.unirioja.es/servlet/articulo?codigo=2952641" }, { "reference": "Lukas Mujika, J. F., Santiago Etxeberria, K., Lizasoain Hern\u00e1ndez, L., & Etxeberia Murgiondo, J. (2016). Percepciones del Alumnado Universitario Sobre la Evaluaci\u00f3n (University students' perceptions of assessment). Bord\u00f3n. Revista de Pedagog\u00eda, 69(1), 103. https://doi.org/https://doi.org/10.13042/Bordon.2016.43843" }, { "reference": "Pardo, A., & Dawson, S. (2016). Learning analytics: How can data be used to improve Learning practice. In P. Reimann, S. Bull, M. Kickmeier-Rust, R. Vatrapu, & B. Wasson (Eds.), Measuring and visualizing learning in the information-rich classroom (pp. 41\u201355). Routledge. https://doi.org/https://doi.org/10.4324/9781315777979" }, { "reference": "Sambell, K., McDowell, L., & Montgomery, C. (2013). Assessment for learning in higher education. Routledge." }, { "reference": "Shibani, A., Knight, S., & Shum, S. B. (2019). Contextualizable learning analytics design: A generic model and writing analytics evaluations. In Proceedings of the 9th International Conference on Learning Analytics & Knowledge (pp. 210\u2013219). https://doi.org/https://doi.org/10.1145/3303772.3303785" }, { "reference": "Singh, J., Steele, K., & Singh, L. (2021). Combining the best of online and face-to-face learning: Hybrid and blended learning approach for COVID-19, post vaccine, & post-pandemic world. Journal of Educational Technology Systems, 50(2), 140\u2013171. https://doi.org/https://doi.org/10.1177/00472395211047865" }, { "reference": "Szirmai, M. (2020). Moodle: The ubiquitous teacher. Electronic Journal of Foreign Language Teaching, 17(s1), 190\u2013204. https://e-flt.nus.edu.sg/wp-content/uploads/2020/09/szirmai.pdf" }, { "reference": "Tervakari, A. M., Silius, K., Koro, J., Paukkeri, J., & Pirttil\u00e4, O. (2014). Usefulness of information visualizations based on educational data (pp. 142\u2013151). https://doi.org/https://doi.org/10.1109/EDUCON.2014.6826081" }, { "reference": "Tran, T. P., & Meacheam, D. (2020). Enhancing learners' experience through extending learning systems. IEEE Transactions on Learning Technologies, 13(3), 540\u2013551. https://doi.org/https://doi.org/10.1109/TLT.2020.2989333" }, { "reference": "Villama\u00f1e, M., Alvarez, A., & Larranaga, M. (2020). CASA, an architecture to support complex assessment scenarios. IEEE Access, 8, 14195\u201314206. https://doi.org/https://doi.org/10.1109/ACCESS.2020.2966595" }, { "reference": "Vujo\u0161evi\u0107-Jani\u010di\u0107, M., Nikoli\u0107, M., To\u0161i\u0107, D., & Kuncak, V. (2013). Software verification and graph similarity for automated evaluation of students' assignments. Information and Software Technology, 55(6), 1004\u20131016. https://doi.org/https://doi.org/10.1016/j.infsof.2012.12.005" }, { "reference": "Watkins, S. (s. f.). Using Moodle gradebook effectively. https://swatkins.wordpress.ncsu.edu/files/2016/04/moodle_gradebook_20160420.pdf" } ], "resource_type": { "id": "publication-article", "title": { "de": "Zeitschriftenartikel", "en": "Journal article" } }, "rights": [ { "description": { "en": "" }, "icon": "cc-by-nc-icon", "id": "cc-by-nc-4.0", "props": { "scheme": "spdx", "url": "https://creativecommons.org/licenses/by-nc/4.0/legalcode" }, "title": { "en": "Creative Commons Attribution Non Commercial 4.0 International" } } ], "title": "Facilitating complex assessment using Moodle" }, "parent": { "access": { "owned_by": { "user": "1055286" }, "settings": { "accept_conditions_text": null, "allow_guest_requests": false, "allow_user_requests": false, "secret_link_expiration": 0 } }, "communities": {}, "id": "10527843", "pids": {} }, "pids": { "doi": { "identifier": "10.1080/10494820.2022.2091614", "provider": "external" }, "oai": { "identifier": "oai:zenodo.org:10527844", "provider": "oai" } }, "revision_id": 10, "stats": { "all_versions": { "data_volume": 27671058.0, "downloads": 54, "unique_downloads": 46, "unique_views": 46, "views": 48 }, "this_version": { "data_volume": 27671058.0, "downloads": 54, "unique_downloads": 46, "unique_views": 46, "views": 48 } }, "status": "published", "swh": {}, "updated": "2024-07-07T11:41:49.254389+00:00", "versions": { "index": 1, "is_latest": true } }