Published July 24, 2014 | Version v1
Journal article Open

A novel approach to diagnosing motor skills

Authors/Creators

  • 1. ROR icon Centro de Estudios e Investigaciones Técnicas de Gipuzkoa
  • 2. Universidad de navarra
  • 3. Universitiy of the Basque Country UPV/EHU
  • 4. University of the Basque Country UPV/EHU

Description

The combination of virtual reality interactive systems and educational technologies have been used in the training of procedural tasks, but there is a lack of research with regard to providing specific assistance for acquiring motor skills. In this paper we present a novel approach to evaluating motor skills with an interactive intelligent learning system based on the ULISES framework. We describe the implementation of the different layers that ULISES is composed of in order to generate a diagnosis of trainees' motor skills. This diagnostic process takes into account the following characteristics of movement: coordination, poses, movement trajectories and the procedure followed in a sequence of movements. In order to validate our work we generated a model for the diagnosis of tennis-related motor skills and we conducted an experiment in which we interpreted and diagnosed tennis serves of several subjects and which shows promising results.

Files

A_Novel_Approach_to_Diagnosing_Motor_Skills.pdf

Files (551.6 kB)

Name Size Download all
md5:8f8c2510dcde1bdf00b7d3048851570c
551.6 kB Preview Download

Additional details

References

  • J. Rickel, J. Gratch, R. HIll, S. Marsella, and W. Swartout, "Stevegoes to Bosnia: Towards a new generation virtual humans forinteractive experiences," in Proc. AAAI Spring Symp. Artif. Intell.Interactive Entertain., 2001, pp. 2-3.
  • P. Fournier-Viger, R. Nkambou, and E. M. Nguifo, "ITS in Illdefineddomains: Toward hybrid approaches an hybrid model incanadarmtutor," in Intelligent Tutoring Systems. Berlin, Germany:Springer, 2010, pp. 318-320.
  • K. Tervo, L. Palmroth, and H. Koivo, "Skill evaluation of humanoperators in partly automated mobile working machines," IEEETrans. Autom. Sci. Eng., vol. 7, no. 1, pp. 133-142, Jan. 2010.
  • V. Medved, Measurement of Human Locomotion. Boca Raton, FL,USA: CRC Press, 2001.
  • D. Weinland, R. Ronfard, and E. Boyer, "A survey of vision-basedmethods for action representation, segmentation and recognition,"Comput. Vis. Image Underst., vol. 115, no. 2, pp. 224-241,Feb. 2011.
  • O. Mena, L. Unzueta, B. Sierra, and L. Matey, "Temporal nearestend-effectors for real-time full-body human actions recognition,"in Articulated Motion and Deformable Objects. Berlin, Germany:Springer, 2008, pp. 269-278.
  • J. F. Allen, "Maintaining knowledge about temporal intervals,"Commun. ACM, vol. 26, no. 11, pp. 832-843, 1983.
  • J. C. Niebles, C.-W. Chen, and L. Fei-Fei, "Modeling temporalstructure of decomposable motion segments for activityclassification," in Proc. 11th Eur. Conf. Comput. Vis., 2010,pp. 392-405.
  • R. M. Gagn-e, The Conditions of Learning and Theory of Instruction.New York, NY, USA: Holt, Rinehart and Winston, 1985.
  • F. Kabanza and R. Nkambou, "Path-planning for autonomoustraining on robot manipulators in space," in Proc. 19th Int. JointConf. Artif. Intell., 2005, pp. 1729-1731.
  • A. Mitrovic and A. Weerasinghe, "Revisiting Ill-definedness andthe consequences for ITSs," in Proc. Conf. Artif. Intell. Educ. Build.Learn. Syst. Care Knowl. Represent. Affect. Model., 2009, vol. 200,p. 375.
  • P. Fournier-Viger, R. Nkambou, E. M. Nguifo, A. Mayers, and U.Faghihi, "A multiparadigm intelligent tutoring system for roboticarm training," IEEE Trans. Learn. Technol., vol. 6, no. 4, pp. 364-377, Oct.-Dec. 2013.
  • J. Yang, Y. Xu, and C. S. Chen, "Human action learning via hiddenMarkov model," IEEE Trans. Syst. Man Cybern. A, Syst. Humans,vol. 27, no. 1, pp. 34-44, Jan. 1997.
  • J. Solis and A. Takanishi, "Enabling autonomous systems to perceptuallydetect human performance improvements and theirapplications," in Proc. IEEE Int. Conf. Autom. Sci. Eng., 2008,pp. 259-264.
  • S. Theodoridis and K. Koutroumbas, "Pattern recognition," CAAcad., San Diego, CA: Academic Press, 1999.
  • S. Cotin, N. Stylopoulos, M. Ottensmeyer, P. Neumann, D. Rattner,and S. Dawson, "Metrics for laparoscopic skills trainers: Theweakest link!," in Proc. 5th Int. Conf. Med. Image Comput. Comput.-Assisted Intervention, 2002, pp. 35-43.
  • J. Rosen, M. Solazzo, B. Hannaford, and M. Sinanan, "Taskdecomposition of laparoscopic surgery for objective evaluation ofsurgical residents' learning curve using hidden Markov model,"Comput. Aided Surg., vol. 7, no. 1, pp. 49-61, 2002.
  • L. Vemer, D. Oleynikov, S. Holtmann, H. Haider, and L. Zhukov,"Measurements of the level of surgical expertise usingflight path analysis from da vinciTM robotic surgical system,"Med. Meets Virtual Real. 11 NextMed Heal. Horiz., vol. 94,p. 373, 2003.
  • Y. Yamauchi, J. Yamashita, O. Morikawa, R. Hashimoto, M.Mochimaru, Y. Fukui, H. Uno, and K. Yokoyama, "Surgical skillevaluation by force data for endoscopic sinus surgery training system,"in Proc. Med. Image Comput. Comput.-Assisted Intervention,2002, pp. 44-51.
  • T. E. Murphy, C. M. Vignes, D. D. Yuh, and A. M. Okamura,"Automatic motion recognition and skill evaluation for dynamictasks," in Proc. Eurohaptics, 2003, pp. 363-373.
  • J. Rosen, B. Hannaford, C. G. Richards, and M. N. Sinanan,"Markov modeling of minimally invasive surgery based on tool/tissue interaction and force/torque signatures for evaluating surgicalskills," IEEE Trans. Biomed. Eng., vol. 48, no. 5, pp. 579-591,May 2001
  • J. Rosen, L. Chang, J. D. Brown, B. Hannaford, M. Sinanan, and R.Satava, "Minimally invasive surgery task decomposition-etymologyof endoscopic suturing," Stud. Hehtmlalth Technol. Informat.,vol. 94, pp. 295-301, 2003.
  • Z. Ruttkay and H. Van Welbergen, "Elbows higher! performing,observing and correcting exercises by a virtual trainer," in Proc.8th Int. Conf. Intell. Virtual Agents, 2008, pp. 409-416.
  • D. Davcev, V. Trajkovic, S. Kalajdziski, and S. Celakoski,"Augmented reality environment for dance learning," in Proc. Int.Conf. Inf. Technol.: Res. Educ., 2003, pp. 189-193.
  • K. Hachimura, H. Kato, and H. Tamura, "A prototype dance trainingsupport system with motion capture and mixed reality technologies,"in Proc. 13th IEEE Int. Workshop Robot Human InteractiveCommun., 2004, pp. 217-222.
  • A. Soga, B. Umino, and M. Hirayama, "Automatic compositionfor contemporary dance using 3D motion clips: Experiment ondance training and system evaluation," in Proc. Int. Conf.,2009, pp. 171-176.
  • K. Hachimura, K. Takashina, and M. Yoshimura, "Analysis andevaluation of dancing movement based on LMA," in Proc. IEEEInt. Workshop Robot Human Interactive Commun., 2005, pp. 294-299.
  • G. Qian, F. Guo, T. Ingalls, L. Olson, J. James, and T. Rikakis, "Agesture-driven multimodal interactive dance system," in Proc.IEEE Int. Conf. Multimedia Expo., 2004, vol. 3, pp. 1579-1582.
  • D. Y. Kwon and M. Gross, "Combining body sensors and visualsensors for motion training," in Proc. ACM SIGCHI Int. Conf. Adv.Comput. Entertainment Technol., 2005, pp. 94-101.
  • J. Chan and H. Leung, "A virtual reality dance training systemusing motion capture technology," IEEE Trans. Learn. Technol.,vol. 4, no. 2, pp. 187-195, Apr.-Jun. 2011.
  • A. Aguirre, A. Lozano-Rodero, M. Villama~ne, B. Ferrero, and L.Matey, "OLYMPUS: An Intelligent interactive learning platformfor procedural tasks," in Proc. Int. Conf. Comput. Graph. TheoryAppl. Conf. Inf. Vis. Theory Appl., 2012, pp. 543-550.
  • J. Clemente, J. Ramrez, and A. de Antonio, "Applying a studentmodeling with non-monotonic diagnosis to intelligent virtualenvironment for training/instruction," Expert Syst. Appl., vol. 41,pp. 508-520, Jul. 2013.
  • A. Lozano-Rodero, "Metodología de desarrollo de sistemas interactivos inteligentes de ayuda al aprendizaje de tareas procedimentales basados en realidad virtual y mixta," Univ. Navarra,Pamplona, Spain, 2009.
  • L. A. Zadeh, "The concept of a linguistic variable and its applicationto approximate reasoning-I," in Inf. Sci., vol. 8, no. 3, pp. 199-249, 1975.
  • A. Panjkota, I. V. O. Stancic, and T. Supuk, "Outline of a qualitativeanalysis for the human motion in case of ergometer rowing," inProc. WSEAS Int. Conf. Math. Comput. Sci. Eng., 2009, pp. 182-186.
  • L. A. Zadeh, "Toward a theory of fuzzy information granulationand its centrality in human reasoning and fuzzy logic," Fuzzy SetsSyst., vol. 90, no. 2, pp. 111-127, 1997.
  • L. Loke, A. Larssen, and T. Robertson, "Labanotation for design ofmovement-based interaction," in Proc. 2nd Australas. Conf. Interact.Entertain., 2005, vol. 2005, pp. 113-120.
  • J. F. Allen, "Towards a general theory of action and time," Artif.Intell., vol. 23, no. 2, pp. 123-154, Jul. 1984.
  • S. Ohlsson, "Constraint-based student modeling," Artif. Intell.Educ., vol. 3, pp. 429-447, 1992.
  • A. Mitrovic, S. Ohlsson, and D. K. Barrow, "The effect of positivefeedback in a constraint-based intelligent tutoring system," Comput.Educ., vol. 60, no. 1, pp. 264-272, Jan. 2013.
  • P. Fournier-Viger and R. Nkambou, "Exploiting partial problemspaces learned from users' interactions to provide key tutoringservices in procedural and ill-defined domains," in Proc. Artif.Intell. Educ.: Building Learn. Syst. Care: From Knowl. RepresentationAffective Model., 2009, pp. 383-390.