Evaluating TESLA-G, a Gamified, Telegram-delivered, Quizzing Platform for Surgical Education in Medical Students

NCT ID: NCT05520671

Last Updated: 2023-04-05

Study Results

Results pending

The study team has not published outcome measurements, participant flow, or safety data for this trial yet. Check back later for updates.

Basic Information

Get a concise snapshot of the trial, including recruitment status, study phase, enrollment targets, and key timeline milestones.

Recruitment Status

UNKNOWN

Clinical Phase

NA

Total Enrollment

50 participants

Study Classification

INTERVENTIONAL

Study Start Date

2023-05-01

Study Completion Date

2023-06-30

Brief Summary

Review the sponsor-provided synopsis that highlights what the study is about and why it is being conducted.

Telegram Education for Surgical Learning and Application Gamified (TESLA-G) is an online, gamified quizzing platform for surgical education in medical students.The main objective of this pilot study is to assess the feasibility and acceptability of carrying out a full randomised control trial involving TESLA-G.

A pilot randomised controlled trial involving 50 undergraduate medical students will be conducted. They will be randomised into an intervention group and an active control group.

Feasibility will be determined by participant enrollment, retention rate, and quiz completion. Acceptability will be measured quantitatively via a post-intervention learner satisfaction survey and qualitatively via semi-structured interviews. Additionally, participants' scores for pre- and post-intervention knowledge tests will be compared.

Detailed Description

Dive into the extended narrative that explains the scientific background, objectives, and procedures in greater depth.

Online multiple-choice question (MCQ) quizzes are a well-established summative assessment tool in medical education. However, they suffer from high drop-out rates, attributed to waning user motivation over time. Various studies have shown that incorporation of gamified elements into learning can promote engagement and motivation.

In this pilot study, we will assess the feasibility and acceptability of a novel gamified quizzing platform, Telegram Education for Surgical Learning and Application Gamified (TESLA-G), to determine the possibility of a future larger-scale randomised controlled trial.

This study entails a randomised controlled trial with two arms, an intervention group (TESLA-G) and an active control group (conventional quizzing platform). 50 first to fifth year medical students from Lee Kong Chian School of Medicine, Nanyang Technological University will be randomised into the two arms with a 1:1 allocation ratio, stratified by year of study. Participants will use the assigned quizzing platform to attempt questions on a specific topic (endocrine surgery) over a period of two weeks.

At the end of the study period, several outcomes will be assessed. Feasibility will be determined by participant enrollment, retention rate, and quiz completion. Acceptability will be measured quantitatively via a post-intervention learner satisfaction survey and qualitatively via semi-structured interviews. Additionally, participants' scores for pre- and post-intervention knowledge tests will be compared.

Conditions

See the medical conditions and disease areas that this research is targeting or investigating.

Surgical Education in Medical Students

Study Design

Understand how the trial is structured, including allocation methods, masking strategies, primary purpose, and other design elements.

Allocation Method

RANDOMIZED

Intervention Model

PARALLEL

This is an online, pilot randomised controlled trial consisting of two parallel active groups - an intervention group and an active control group. Participants will be randomised into each group with a 1:1 allocation ratio, stratified by year of study.
Primary Study Purpose

OTHER

Blinding Strategy

TRIPLE

Participants Investigators Outcome Assessors
Participants will be subjected to partial blinding, where the type of platform (i.e. conventional quizzing platform or TESLA-G) will not be revealed to them. Instead, participants will be informed that one of the two platforms has been randomly assigned to them. In addition, all researchers involved in statistical analysis will be blinded as far as possible. Until the data has been fully analysed, they will not be able to identify the nature of each of the two groups.

A single, non-blinded researcher will be in charge of conveying information to participants. This is to ensure that important instructions on accessing and using the platforms, which are different for each platform, are sent to the participants. This researcher will also be the point-of-contact for the participants' platform-related queries throughout the study.

Study Groups

Review each arm or cohort in the study, along with the interventions and objectives associated with them.

TESLA-G

Participants will be randomised into the two arms with a 1:1 allocation ratio stratified by year of study. There will be 25 participants in this arm.

Group Type EXPERIMENTAL

Gamified online quizzing platform

Intervention Type OTHER

TESLA-G is a novel gamified quizzing platform designed based on Bloom's taxonomy of learning domains. Questions will be created in blocks, where each block will test a specific topic within a specialty (endocrine surgery has been selected for this study). Each block has 5 questions, and each question corresponds to each level of Bloom's taxonomy and each level in game.

For this study, we aim to create 56 blocks of 5 questions, totalling 280 questions. All questions will be created by two board-certified general surgeons and one endocrinologist, and validated by the research team.

The aim of the game is for players to get as many points as they can before the timer runs out. Gamification elements include levels, countdown timer, lives, a point multiplier system, leaderboard rankings and a personalised dashboard.

Participants in the intervention group will be provided with a link to access TESLA-G, sent from an automated Telegram bot; this access will be provided for 14 days.

Control

Participants will be randomised into the two arms with a 1:1 allocation ratio stratified by year of study. There will be 25 participants in this arm.

Group Type ACTIVE_COMPARATOR

Conventional quizzing platform

Intervention Type OTHER

The conventional quizzing platform will be a modified version of TESLA-G with all gamification elements removed. The same set of questions as the gamified version will be used. Upon entering the quiz, a question stem and five choices will be shown. When an option is selected, the right answer along with its explanation will be indicated. The next question will then be sent, and this process repeats until the participant leaves the platform or has answered every question.

Questions will be queued in blocks, with each block corresponding to a particular topic in endocrine surgery. Unlike the gamified version, questions within each block will be randomised, regardless of their level on the Bloom's taxonomy. Participants will also not be informed of the level of Bloom's taxonomy for individual questions. The access link to the platform will be sent to participants from an automated Telegram bot, and this access will last for 14 days.

Interventions

Learn about the drugs, procedures, or behavioral strategies being tested and how they are applied within this trial.

Gamified online quizzing platform

TESLA-G is a novel gamified quizzing platform designed based on Bloom's taxonomy of learning domains. Questions will be created in blocks, where each block will test a specific topic within a specialty (endocrine surgery has been selected for this study). Each block has 5 questions, and each question corresponds to each level of Bloom's taxonomy and each level in game.

For this study, we aim to create 56 blocks of 5 questions, totalling 280 questions. All questions will be created by two board-certified general surgeons and one endocrinologist, and validated by the research team.

The aim of the game is for players to get as many points as they can before the timer runs out. Gamification elements include levels, countdown timer, lives, a point multiplier system, leaderboard rankings and a personalised dashboard.

Participants in the intervention group will be provided with a link to access TESLA-G, sent from an automated Telegram bot; this access will be provided for 14 days.

Intervention Type OTHER

Conventional quizzing platform

The conventional quizzing platform will be a modified version of TESLA-G with all gamification elements removed. The same set of questions as the gamified version will be used. Upon entering the quiz, a question stem and five choices will be shown. When an option is selected, the right answer along with its explanation will be indicated. The next question will then be sent, and this process repeats until the participant leaves the platform or has answered every question.

Questions will be queued in blocks, with each block corresponding to a particular topic in endocrine surgery. Unlike the gamified version, questions within each block will be randomised, regardless of their level on the Bloom's taxonomy. Participants will also not be informed of the level of Bloom's taxonomy for individual questions. The access link to the platform will be sent to participants from an automated Telegram bot, and this access will last for 14 days.

Intervention Type OTHER

Eligibility Criteria

Check the participation requirements, including inclusion and exclusion rules, age limits, and whether healthy volunteers are accepted.

Inclusion Criteria

* Currently enrolled in a full-time 5-year undergraduate programme in the medical school that leads to the Bachelor of Medicine and Bachelor of Surgery (MBBS)
* Willing and able to provide consent for participating in the entire duration of the study including all pre- and post-study assessments

Exclusion Criteria

* NIL
Minimum Eligible Age

18 Years

Maximum Eligible Age

100 Years

Eligible Sex

ALL

Accepts Healthy Volunteers

Yes

Sponsors

Meet the organizations funding or collaborating on the study and learn about their roles.

Nanyang Technological University

OTHER

Sponsor Role lead

Responsible Party

Identify the individual or organization who holds primary responsibility for the study information submitted to regulators.

Lorainne Tudor Car

Assistant Professor

Responsibility Role PRINCIPAL_INVESTIGATOR

Principal Investigators

Learn about the lead researchers overseeing the trial and their institutional affiliations.

Clement, Luck Khng Chia, MBBS, MS

Role: PRINCIPAL_INVESTIGATOR

Department of General Surgery, Khoo Teck Puat Hospital, Singapore

Lorainne Tudor Car, MBBS, PhD

Role: PRINCIPAL_INVESTIGATOR

Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore

Central Contacts

Reach out to these primary contacts for questions about participation or study logistics.

Clement, Luck Khng Chia, MBBS, MS

Role: CONTACT

+65 6602 2207

Matthew, Song Peng Ng, MBBS

Role: CONTACT

+65 9644 1701

References

Explore related publications, articles, or registry entries linked to this study.

Douthit NT, Norcini J, Mazuz K, Alkan M, Feuerstein MT, Clarfield AM, Dwolatzky T, Solomonov E, Waksman I, Biswas S. Assessment of Global Health Education: The Role of Multiple-Choice Questions. Front Public Health. 2021 Jul 22;9:640204. doi: 10.3389/fpubh.2021.640204. eCollection 2021.

Reference Type BACKGROUND
PMID: 34368038 (View on PubMed)

St-Onge C, Young M, Renaud JS, Cummings BA, Drescher O, Varpio L. Sound Practices: An Exploratory Study of Building and Monitoring Multiple-Choice Exams at Canadian Undergraduate Medical Education Programs. Acad Med. 2021 Feb 1;96(2):271-277. doi: 10.1097/ACM.0000000000003659.

Reference Type BACKGROUND
PMID: 32769474 (View on PubMed)

Ryan A, Judd T, Swanson D, Larsen DP, Elliott S, Tzanetos K, Kulasegaram K. Beyond right or wrong: More effective feedback for formative multiple-choice tests. Perspect Med Educ. 2020 Oct;9(5):307-313. doi: 10.1007/s40037-020-00606-z.

Reference Type BACKGROUND
PMID: 32789664 (View on PubMed)

Yang BW, Razo J, Persky AM. Using Testing as a Learning Tool. Am J Pharm Educ. 2019 Nov;83(9):7324. doi: 10.5688/ajpe7324.

Reference Type BACKGROUND
PMID: 31871352 (View on PubMed)

Roediger HL, Karpicke JD. Test-enhanced learning: taking memory tests improves long-term retention. Psychol Sci. 2006 Mar;17(3):249-55. doi: 10.1111/j.1467-9280.2006.01693.x.

Reference Type BACKGROUND
PMID: 16507066 (View on PubMed)

Larsen DP, Butler AC, Roediger HL 3rd. Test-enhanced learning in medical education. Med Educ. 2008 Oct;42(10):959-66. doi: 10.1111/j.1365-2923.2008.03124.x.

Reference Type BACKGROUND
PMID: 18823514 (View on PubMed)

Jud SM, Cupisti S, Frobenius W, Winkler A, Schultheis F, Antoniadis S, Beckmann MW, Heindl F. Introducing multiple-choice questions to promote learning for medical students: effect on exam performance in obstetrics and gynecology. Arch Gynecol Obstet. 2020 Dec;302(6):1401-1406. doi: 10.1007/s00404-020-05758-1. Epub 2020 Aug 31.

Reference Type BACKGROUND
PMID: 32865608 (View on PubMed)

Ayyub A, Mahboob U. Effectiveness of Test-Enhanced Learning (TEL) in lectures for undergraduate medical students. Pak J Med Sci. 2017 Nov-Dec;33(6):1339-1343. doi: 10.12669/pjms.336.13358.

Reference Type BACKGROUND
PMID: 29492055 (View on PubMed)

Green ML, Moeller JJ, Spak JM. Test-enhanced learning in health professions education: A systematic review: BEME Guide No. 48. Med Teach. 2018 Apr;40(4):337-350. doi: 10.1080/0142159X.2018.1430354. Epub 2018 Feb 1.

Reference Type BACKGROUND
PMID: 29390949 (View on PubMed)

Pei L, Wu H. Does online learning work better than offline learning in undergraduate medical education? A systematic review and meta-analysis. Med Educ Online. 2019 Dec;24(1):1666538. doi: 10.1080/10872981.2019.1666538.

Reference Type BACKGROUND
PMID: 31526248 (View on PubMed)

Vaona A, Banzi R, Kwag KH, Rigon G, Cereda D, Pecoraro V, Tramacere I, Moja L. E-learning for health professionals. Cochrane Database Syst Rev. 2018 Jan 21;1(1):CD011736. doi: 10.1002/14651858.CD011736.pub2.

Reference Type BACKGROUND
PMID: 29355907 (View on PubMed)

Brame CJ, Biel R. Test-enhanced learning: the potential for testing to promote greater learning in undergraduate science courses. CBE Life Sci Educ. 2015 Summer;14(2):14:es4. doi: 10.1187/cbe.14-11-0208.

Reference Type BACKGROUND
PMID: 25999314 (View on PubMed)

Mitra NK, Barua A. Effect of online formative assessment on summative performance in integrated musculoskeletal system module. BMC Med Educ. 2015 Mar 3;15:29. doi: 10.1186/s12909-015-0318-1.

Reference Type BACKGROUND
PMID: 25884641 (View on PubMed)

Orr R, Foster S. Increasing student success using online quizzing in introductory (majors) biology. CBE Life Sci Educ. 2013 Fall;12(3):509-14. doi: 10.1187/cbe.12-10-0183.

Reference Type BACKGROUND
PMID: 24006398 (View on PubMed)

Kibble J. Use of unsupervised online quizzes as formative assessment in a medical physiology course: effects of incentives on student participation and performance. Adv Physiol Educ. 2007 Sep;31(3):253-60. doi: 10.1152/advan.00027.2007.

Reference Type BACKGROUND
PMID: 17848591 (View on PubMed)

van Gaalen AEJ, Brouwer J, Schonrock-Adema J, Bouwkamp-Timmer T, Jaarsma ADC, Georgiadis JR. Gamification of health professions education: a systematic review. Adv Health Sci Educ Theory Pract. 2021 May;26(2):683-711. doi: 10.1007/s10459-020-10000-3. Epub 2020 Oct 31.

Reference Type BACKGROUND
PMID: 33128662 (View on PubMed)

Gentry SV, Gauthier A, L'Estrade Ehrstrom B, Wortley D, Lilienthal A, Tudor Car L, Dauwels-Okutsu S, Nikolaou CK, Zary N, Campbell J, Car J. Serious Gaming and Gamification Education in Health Professions: Systematic Review. J Med Internet Res. 2019 Mar 28;21(3):e12994. doi: 10.2196/12994.

Reference Type BACKGROUND
PMID: 30920375 (View on PubMed)

Nevin CR, Westfall AO, Rodriguez JM, Dempsey DM, Cherrington A, Roy B, Patel M, Willig JH. Gamification as a tool for enhancing graduate medical education. Postgrad Med J. 2014 Dec;90(1070):685-93. doi: 10.1136/postgradmedj-2013-132486. Epub 2014 Oct 28.

Reference Type BACKGROUND
PMID: 25352673 (View on PubMed)

Coleman E, O'Connor E. The role of WhatsApp(R) in medical education; a scoping review and instructional design model. BMC Med Educ. 2019 Jul 25;19(1):279. doi: 10.1186/s12909-019-1706-8.

Reference Type BACKGROUND
PMID: 31345202 (View on PubMed)

Bakshi SG, Bhawalkar P. Role of WhatsApp-based discussions in improving residents' knowledge of post-operative pain management: a pilot study. Korean J Anesthesiol. 2017 Oct;70(5):542-549. doi: 10.4097/kjae.2017.70.5.542. Epub 2017 May 19.

Reference Type BACKGROUND
PMID: 29046774 (View on PubMed)

Blumenfeld O, Brand R. Real time medical learning using the WhatsApp cellular network: a cross sectional study following the experience of a division's medical officers in the Israel Defense Forces. Disaster Mil Med. 2016 Aug 9;2:12. doi: 10.1186/s40696-016-0022-7. eCollection 2016.

Reference Type BACKGROUND
PMID: 28265446 (View on PubMed)

Alhalabi N, Salloum R, Aless A, Darjazini Nahas L, Ibrahim N. Messaging apps use in undergraduate medical education: The case of National Medical Unified Examination. Ann Med Surg (Lond). 2021 Jun 5;66:102465. doi: 10.1016/j.amsu.2021.102465. eCollection 2021 Jun.

Reference Type BACKGROUND
PMID: 34178316 (View on PubMed)

Iqbal MZ, Alradhi HI, Alhumaidi AA, Alshaikh KH, AlObaid AM, Alhashim MT, AlSheikh MH. Telegram as a Tool to Supplement Online Medical Education During COVID-19 Crisis. Acta Inform Med. 2020 Jun;28(2):94-97. doi: 10.5455/aim.2020.28.94-97.

Reference Type BACKGROUND
PMID: 32742059 (View on PubMed)

Skivington K, Matthews L, Simpson SA, Craig P, Baird J, Blazeby JM, Boyd KA, Craig N, French DP, McIntosh E, Petticrew M, Rycroft-Malone J, White M, Moore L. A new framework for developing and evaluating complex interventions: update of Medical Research Council guidance. BMJ. 2021 Sep 30;374:n2061. doi: 10.1136/bmj.n2061.

Reference Type BACKGROUND
PMID: 34593508 (View on PubMed)

Blanie A, Amorim MA, Benhamou D. Comparative value of a simulation by gaming and a traditional teaching method to improve clinical reasoning skills necessary to detect patient deterioration: a randomized study in nursing students. BMC Med Educ. 2020 Feb 19;20(1):53. doi: 10.1186/s12909-020-1939-6.

Reference Type BACKGROUND
PMID: 32075641 (View on PubMed)

Plana NM, Rifkin WJ, Kantar RS, David JA, Maliha SG, Farber SJ, Staffenberg DA, Grayson BH, Diaz-Siso JR, Flores RL. A Prospective, Randomized, Blinded Trial Comparing Digital Simulation to Textbook for Cleft Surgery Education. Plast Reconstr Surg. 2019 Jan;143(1):202-209. doi: 10.1097/PRS.0000000000005093.

Reference Type BACKGROUND
PMID: 30325894 (View on PubMed)

Bell ML, Whitehead AL, Julious SA. Guidance for using pilot studies to inform the design of intervention trials with continuous outcomes. Clin Epidemiol. 2018 Jan 18;10:153-157. doi: 10.2147/CLEP.S146397. eCollection 2018.

Reference Type BACKGROUND
PMID: 29403314 (View on PubMed)

Whitehead AL, Julious SA, Cooper CL, Campbell MJ. Estimating the sample size for a pilot randomised trial to minimise the overall trial sample size for the external pilot and main trial for a continuous outcome variable. Stat Methods Med Res. 2016 Jun;25(3):1057-73. doi: 10.1177/0962280215588241. Epub 2015 Jun 19.

Reference Type BACKGROUND
PMID: 26092476 (View on PubMed)

Tuma F, Nassar AK. Applying Bloom's taxonomy in clinical surgery: Practical examples. Ann Med Surg (Lond). 2021 Aug 5;69:102656. doi: 10.1016/j.amsu.2021.102656. eCollection 2021 Sep.

Reference Type BACKGROUND
PMID: 34429945 (View on PubMed)

Ng MSP, Jabir AI, Ng TR, Ang YI, Chia JL, Tan DNH, Lee J, Mahendran DCJ, Tudor Car L, Chia CLK. Evaluating TESLA-G, a gamified, telegram-delivered, quizzing platform for surgical education in medical students: protocol for a pilot randomised controlled trial. BMJ Open. 2023 Jun 28;13(6):e068740. doi: 10.1136/bmjopen-2022-068740.

Reference Type DERIVED
PMID: 37380211 (View on PubMed)

Related Links

Access external resources that provide additional context or updates about the study.

http://gamification-research.org/wp-content/uploads/2011/04/02-Deterding-Khaled-Nacke-Dixon.pdf

Deterding S, Khaled R, Nacke LE. Gamification: Toward a definition. CHI 2011 gamification Published Online First: 2011.

https://ieeexplore.ieee.org/document/7317765

Morillas Barrio C, Munoz-Organero M, Sanchez Soriano J. Can gamification improve the benefits of student response systems in learning? An experimental study. IEEE Trans Emerg Top Comput 2016;4:429-38.

https://doi.org/10.1186/s41039-018-0078-8

Licorish SA, Owen HE, Daniel B, et al. Students' perception of Kahoot!'s influence on teaching and learning. Research and Practice in Technology Enhanced Learning 2018;13:1-23.

https://sensortower.com/blog/top-apps-worldwide-january-2021-by-downloads

Top Apps Worldwide for January 2021 by Downloads. (accessed 23 May 2022)

https://www.statista.com/statistics/258749/most-popular-global-mobile-messenger-apps/

Most popular messaging apps. Statista. (accessed 23 May 2022).

https://www.taylorfrancis.com/chapters/edit/10.1201/9781498710411-35/sus-quick-dirty-usability-scale-john-brooke

Brooke J. Sus: a 'quick and dirty' usability scale. Usability evaluation in industry Published Online First: 1996.

https://preprints.jmir.org/preprint/35983

Soon MKS, Martinengo L, Lu J, et al. Telegram Education for Surgical Learning and Application (TESLA): An exploratory study. JMIR Preprints. 2021.

https://books.google.com.sg/books?id=QncH02-bvjoC&printsec=frontcover&source=gbs_ViewAPI&redir_esc=y#v=onepage&q&f=false

Sauro J, Lewis JR. Quantifying the User Experience: Practical Statistics for User Research. Morgan Kaufmann 2016.

https://doi.org/10.1007/s10734-014-9837-7

Grammatikopoulos V, Linardakis M, Gregoriadis A, et al. Assessing the Students' Evaluations of Educational Quality (SEEQ) questionnaire in Greek higher education. High Educ 2015;70:395-408.

https://www.ncbi.nlm.nih.gov/books/NBK559109/

Orgill BD, Nolin J. Learning Taxonomies in Medical Simulation. In: StatPearls. Treasure Island (FL): : StatPearls Publishing 2022.

Other Identifiers

Review additional registry numbers or institutional identifiers associated with this trial.

SGG20/SN02

Identifier Type: -

Identifier Source: org_study_id

More Related Trials

Additional clinical trials that may be relevant based on similarity analysis.

Hybrid Course Assessment and Evaluation
NCT06409273 NOT_YET_RECRUITING NA