Usability Evaluation of the MeMo Tutor: A Scaffolding-Based Pedagogical Agent to Facilitate Learning

Ati Suci Dian Martha, Harry Budi Santoso, Kasiyah Junus, Heru Suhartanto

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Nowadays, distance learning faces challenges in increasing students' cognitive engagement and motivation. Research on pedagogical agents is one of the solutions offered to overcome the challenges. MeMo Tutor, the pedagogical agent in this study, acts as a scaffold using integrated metacognitive and motivational scaffoldings. This study was conducted to evaluate the usability of the MeMo Tutor by measuring the level of user satisfaction when using the application. Measuring usability helps determine how usable (e.g., effective, efficient, easy to learn) the system from users' perspective, determine whether any issues need to be fixed, and monitor the performance of the system design over time. The usability evaluation process involved thirteen participants in the first iteration and fifty-six participants in the second iteration. Evaluation data were collected and analyzed using an online prototype analytical tool and System Usability Scale (SUS). In the first iteration, the usability score shows that users were often confused by ambiguous words, especially if the words were close together. This study shows that the average usability score of the online prototype analytical tool correlates well with the average SUS score in the second iteration. The usability results obtained were 88 fromthe online prototype analytical tool and 81.16 from SUS. The score indicates that users were satisfied with the MeMo Tutor application. We recommend focusing on developing mobile-based or responsive web interfaces to improve user experience. In addition, it is crucial to analyze the relationship between the learner's experience and the learning achievement obtained by the user after using the MeMo Tutor.

Original languageEnglish
Title of host publicationProceedings - 2021 International Conference on Software Engineering and Computer Systems and 4th International Conference on Computational Science and Information Management, ICSECS-ICOCSIM 2021
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages360-364
Number of pages5
ISBN (Electronic)9781665414074
DOIs
Publication statusPublished - Aug 2021
Event7th International Conference on Software Engineering and Computer Systems and 4th International Conference on Computational Science and Information Management, ICSECS-ICOCSIM 2021 - Virtual, Pekan, Malaysia
Duration: 24 Aug 202126 Aug 2021

Publication series

NameProceedings - 2021 International Conference on Software Engineering and Computer Systems and 4th International Conference on Computational Science and Information Management, ICSECS-ICOCSIM 2021

Conference

Conference7th International Conference on Software Engineering and Computer Systems and 4th International Conference on Computational Science and Information Management, ICSECS-ICOCSIM 2021
Country/TerritoryMalaysia
CityVirtual, Pekan
Period24/08/2126/08/21

Keywords

  • analytical prototype tool
  • MeMo Tutor
  • metacognitive
  • motivation
  • online learning
  • pedagogical agent
  • scaffolding
  • SUS
  • usability evaluation

Fingerprint

Dive into the research topics of 'Usability Evaluation of the MeMo Tutor: A Scaffolding-Based Pedagogical Agent to Facilitate Learning'. Together they form a unique fingerprint.

Cite this