URAISE: Ultrasound Regional Anaesthesia Interpretation Skill Evaluation

NCT ID: NCT05668689

Last Updated: 2023-07-19

Study Results

Results pending

The study team has not published outcome measurements, participant flow, or safety data for this trial yet. Check back later for updates.

Basic Information

Get a concise snapshot of the trial, including recruitment status, study phase, enrollment targets, and key timeline milestones.

Recruitment Status

UNKNOWN

Clinical Phase

NA

Total Enrollment

300 participants

Study Classification

INTERVENTIONAL

Study Start Date

2022-02-13

Study Completion Date

2025-04-30

Brief Summary

Review the sponsor-provided synopsis that highlights what the study is about and why it is being conducted.

Prospective study based on psychometric principles.#

To generate a validated test of ultrasound guided regional anaesthesia that can used to differentiate reliably between users of different skill levels.

Primary outcome:

Development of a validated, reliable and defensible tool to test ultrasound guided regional anaesthesia image interpretation skills.

Secondary outcomes:

Development a validated, reliable and defensible assessment tool assessing anatomical, clinical knowledge and the performance of ultrasound guided regional anaesthesia:

Assessment of anatomical knowledge relevant to performing a local anaesthetic injection around peripheral nerves

Assessment of clinical knowledge relevant to regional anaesthesia required to perform a local anaesthetic injection around peripheral nerves

Assessment of knowledge relating to the performance of an ultrasound-guided local anaesthetic injection around peripheral nerve

Detailed Description

Dive into the extended narrative that explains the scientific background, objectives, and procedures in greater depth.

This is a prospective, multi-centre study leading to the identification of a validated, reliable and defensible tool for assessing ultrasound-guided regional anaesthesia (UGRA) image interpretation.

This study will have 5 Phases:

Phase 1 - nerve block identification:

A panel of academic experts in regional anaesthesia will review published evidence from UGRA international guidelines. They will determine which UGRA nerve blocks are relevant to anaesthetic practice in the UK, and list the anatomical and clinical knowledge that is relevant to performing these nerve blocks.

Phase 2 - content and question generation:

A panel of experts in regional anaesthesia, recognised for their involvement in regional anaesthesia societies and publications, will review the UGRA nerve blocks and the relevant anatomical structures identified in Phase 1. The anatomical structures that must be identified on ultrasound for the safe and effective performance of these blocks will be agreed upon following panel discussion. Each structure will be categorised as either:

* Essential
* Desirable
* Expert
* Not relevant

This information will be collated by the Primary and Co-investigators to generate a pilot test of UGRA interpretation content and questions.

Phase 3 - preliminary testing:

The pilot test will be administered by local investigators via a computer-based application to 35-50 anaesthetic trainees and consultants, recruited by email and flyers sent to schools of anaesthesia across the UK. The cohorts will include an equal number of trainees and consultants of varying regional anaesthesia and clinical experience. The pilot test will contain short video clips and images of ultrasound guided regional anaesthesia with questions in a constructed response question (CRQ) format to identify relevant structures, anatomy and clinical knowledge, which will require the participant to write free-text responses to questions. It is important to recognise that some participants will be familiar with the CRQ format while others might be more familiar with other forms of assessment question. Participants in the pilot will therefore be provided with sample questions and answers prior to the test to familiarise themselves with the question format.

"Face validity" of the test (i.e. whether it measures what it claims to) will be assessed by asking participants to comment on ease of understanding and to identify terms that appear ambiguous. Participants will be able to comment in a text box after each item in the questionnaire. They will also be asked to comment on how they would improve the test and any relevant anatomy or clinical knowledge missing from the questions. The format of the test will be amended based on the comments.

A "Difficulty Index" for each item will be calculated by dividing the number of correct responses by the total number of responses. A higher value suggests a question is easier to answer. Any item with a difficulty index of \< 50% will be considered too difficult to answer by the respondents and will be considered for removal. This will be compared to the information gathered from the panel of experts on test items (that is, whether the anatomical structure is essential, desirable, expert or not relevant to the specific ultrasound guided nerve block).

The pilot study will be used to identify how well the answers for each test item discriminate between the participant's level of ultrasound experience ("construct validity"). Differences in ultrasound interpretation skills between study groups will be analysed using statistical modelling. Items that discriminate well will be retained and those that discriminate poorly will be removed from the main test.

Reliability of the test will be improved by presenting the pilot test items in a random order to minimise the effect of cognitive fatigue diminishing performance on subsequent items. The average time taken for participants to complete each item in the pilot test will also be recorded to guide the optimal final study test length. It is important to balance the maximum number of test items whilst minimising the risk of cognitive fatigue and participant drop out. While the pilot test will necessarily have more items than the final test, pilot test participants will be asked to comment on the point at which they felt fatigued to guide this balance. It will also guide understanding of whether the level of regional anaesthesia experience affects fatiguability.

Phase 4 - testing for content validity:

To ensure all items in the assessment tool contain content that tests the domain the investigators intend to test, following the pilot the amended test will be presented to the panel of 5 experts in regional anaesthesia, who will be asked to rate the suitability of ultrasound images and questions to performance of the block. This will be on a 4-point Likert scale:

1. = definitely not suitable
2. = probably not suitable
3. = probably suitable
4. = definitely suitable The "content validity" (i.e. the extent to which a measure fairly represents a particular domain) will be derived by dividing the number of experts who rated the item as probably suitable and definitely suitable (3 and 4 on the scale) by the total number of experts. Items found to be appropriate by a sufficiently high percentage of participants will be selected.

Phase 5: psychometric main study testing The final assessment tool will be administered to an equal number of anaesthetists of varying regional anaesthesia experience. Participants will be recruited using emails and flyers sent to schools of anaesthesia across the UK. Each participant will answer a series of demographic questions, including age, gender, handedness, as well as level of training and practical experience in UGRA to account for inconsistencies in clinical exposure at different stages of training.

The exam will consist of constructed response questions (CRQs). Participants will be provided with sample questions and answers before the test to familiarise themselves with the question format. The construct validity of the tool will be tested by comparing the scores of anaesthetists with their level of experience in regional anaesthesia. The level of experience is a proxy outcome measure for their proficiency in ultrasound-guided regional anaesthesia. Differences in ultrasound interpretation skills between study groups will be analysed using statistical modelling. At the end of the assessment, there will be a short questionnaire to ascertain ease of understanding and suitability of ultrasound images to support the face validity of the test.

The "internal reliability" (i.e. the consistency of results across items in a test) of the responses will be assessed using statistical modelling. A split-test method will also be used for each participant to compare the first half of their assessment with the second half to ensure internal consistency of their item responses. The difficulty index calculated for items in the pilot study will be used to ensure a balanced set of test items, in terms of their difficulty, in the first and second halves of the test. All items will be made mandatory. The test will be administered by local investigators via a web-based application. It will have an automatic system of marking to minimise inter-marker differences. It will also be manually checked by investigators who are blinded to the level and identity of the participant.

The investigators will aim to recruit a minimum of 250 participants, each of whom will be allocated a participant number to maintain anonymity.

The results will be analysed only when recruitment has ended.

Conditions

See the medical conditions and disease areas that this research is targeting or investigating.

Anesthesia

Study Design

Understand how the trial is structured, including allocation methods, masking strategies, primary purpose, and other design elements.

Allocation Method

RANDOMIZED

Intervention Model

SEQUENTIAL

Phase 1 Nerve block identification

Phase 2 Content and question generation

Phase 3 Preliminary testing

Phase 4 Testing for content validity

Phase 5 Psychometric main study testing
Primary Study Purpose

OTHER

Blinding Strategy

DOUBLE

Participants Investigators
Participants Participants will complete the test online or face-face and questions for each participant will be presented in a random order - no test is the same. Participants will not know the result of the test.

Investigators Each participant will be identified by a unique sequential number identifier allocated to them and this will ensure all participants will have pseudo-anonymised data. Investigators can only veiw the pseudo-anonymised results.

Study Groups

Review each arm or cohort in the study, along with the interventions and objectives associated with them.

Preliminary testing (Phase 3)

The pilot test will be administered by local investigators via a computer-based application to 35-50 trainees and consultants.

Group Type OTHER

Preliminary testing

Intervention Type OTHER

The pilot test will be administered by local investigators via a computer-based application to 35-50 trainees and consultants. The cohorts will include an equal number of trainees and consultants of varying experience, based on the new RCOA curriculum and the extent of their regional experience (stage 1 (CT1-3); stage 2 (ST4-5); stage 3 (ST6-7); stage 3 + regional fellowship trained; consultant; consultant with special interest in regional; consultant + regional fellowship trained). The pilot test will contain short video clips and images of ultrasound guided regional anaesthesia with questions in a constructed response question (CRQ) format to identify relevant structures, anatomy and clinical knowledge.

Psychometric main study testing (Phase 5)

The main study assessment tool will be administered to trainees of all levels and consultants, aiming to recruit an equal number across different stages of the RCoA curriculum and of varying regional anaesthesia experience (stage 1; stage 2; stage 3; stage 3 + regional fellowship trained; consultant; consultant with special interest in regional; consultant + regional fellowship trained).

Group Type OTHER

Psychometric main study testing (Phase 5)

Intervention Type OTHER

The main study assessment tool will be administered to trainees of all levels and consultants, aiming to recruit an equal number across different stages of the RCoA curriculum and of varying regional anaesthesia experience (stage 1; stage 2; stage 3; stage 3 + regional fellowship trained; consultant; consultant with special interest in regional; consultant + regional fellowship trained). The exam will consist of constructed response questions (CRQs), which will require the participant to write free-text responses to questions, in line with RCoA examinations.

Interventions

Learn about the drugs, procedures, or behavioral strategies being tested and how they are applied within this trial.

Preliminary testing

The pilot test will be administered by local investigators via a computer-based application to 35-50 trainees and consultants. The cohorts will include an equal number of trainees and consultants of varying experience, based on the new RCOA curriculum and the extent of their regional experience (stage 1 (CT1-3); stage 2 (ST4-5); stage 3 (ST6-7); stage 3 + regional fellowship trained; consultant; consultant with special interest in regional; consultant + regional fellowship trained). The pilot test will contain short video clips and images of ultrasound guided regional anaesthesia with questions in a constructed response question (CRQ) format to identify relevant structures, anatomy and clinical knowledge.

Intervention Type OTHER

Psychometric main study testing (Phase 5)

The main study assessment tool will be administered to trainees of all levels and consultants, aiming to recruit an equal number across different stages of the RCoA curriculum and of varying regional anaesthesia experience (stage 1; stage 2; stage 3; stage 3 + regional fellowship trained; consultant; consultant with special interest in regional; consultant + regional fellowship trained). The exam will consist of constructed response questions (CRQs), which will require the participant to write free-text responses to questions, in line with RCoA examinations.

Intervention Type OTHER

Eligibility Criteria

Check the participation requirements, including inclusion and exclusion rules, age limits, and whether healthy volunteers are accepted.

Inclusion Criteria

* Participants registered in an approved UK anaesthetic training program OR
* Anaesthetic consultants on the GMC register

Exclusion Criteria

* Not registered in an approved UK anaesthetic training program OR
* Not anaesthetic consultants on the GMC register
Eligible Sex

ALL

Accepts Healthy Volunteers

Yes

Sponsors

Meet the organizations funding or collaborating on the study and learn about their roles.

Imperial College Healthcare NHS Trust

OTHER

Sponsor Role lead

Responsible Party

Identify the individual or organization who holds primary responsibility for the study information submitted to regulators.

Responsibility Role SPONSOR

Principal Investigators

Learn about the lead researchers overseeing the trial and their institutional affiliations.

Boyne Bellew

Role: PRINCIPAL_INVESTIGATOR

Imperial College Healthcare NHS Trust

Locations

Explore where the study is taking place and check the recruitment status at each participating site.

Belfast Health & Social Care Trust

Belfast, , United Kingdom

Site Status RECRUITING

NHS Greater Glasgow and Clyde

Glasgow, , United Kingdom

Site Status RECRUITING

Guy'S and St Thomas' Nhs Foundation Trust

London, , United Kingdom

Site Status RECRUITING

Imperial College Healthcare NHS Trust

London, , United Kingdom

Site Status RECRUITING

Aneurin Bevan University Lhb

Newport, , United Kingdom

Site Status RECRUITING

Southern Health & Social Care Trust

Portadown, , United Kingdom

Site Status RECRUITING

Countries

Review the countries where the study has at least one active or historical site.

United Kingdom

Central Contacts

Reach out to these primary contacts for questions about participation or study logistics.

Boyne Bellew

Role: CONTACT

+442033121248

Sam Haddad

Role: CONTACT

+442033121248

Facility Contacts

Find local site contact details for specific facilities participating in the trial.

Lloyd Turbitt

Role: primary

Alan MacFarlane

Role: primary

AMIT PAWA

Role: primary

Boyne Bellew

Role: primary

+442033121248

Sam Haddad

Role: backup

+442033121248

James Bowness

Role: primary

PETER MERJAVY

Role: primary

Provided Documents

Download supplemental materials such as informed consent forms, study protocols, or participant manuals.

Document Type: Study Protocol and Statistical Analysis Plan

View Document

Other Identifiers

Review additional registry numbers or institutional identifiers associated with this trial.

294856

Identifier Type: -

Identifier Source: org_study_id

More Related Trials

Additional clinical trials that may be relevant based on similarity analysis.

Comparison of Sevoflurane and Propofol on ANI
NCT06907823 NOT_YET_RECRUITING NA
Consent in Anaesthesia
NCT06115720 NOT_YET_RECRUITING NA