ClinicalTrials.gg
CompletedNCT03312218Updated Feb 12, 2021Results posted

The Study Guide Cluster Randomized Control Trial

An interventional study of Spaced educational intervention in Behavior, sponsored by Jewish General Hospital. Completed at 1 site in Canada. Per ClinicalTrials.gov, last updated 2021-02-12.

Sponsored by Jewish General Hospital · Not applicable, Interventional, and Other

Phase
Not applicable
Study type
Interventional
Enrollment
634
Allocation
Randomized
Sex
All
01

Study summary

Spaced education is a promising theory-driven strategy to improve clinical competence. Our aim is to improve the clinical competence of Family Physicians, an outcome associated with the quality of care delivered to Canadians.

Read the detailed description

Research Question: Among family medicine residents, does enhanced feedback through an app providing alerts and test questions (spaced education), compared to the same app without alerts and enhanced feedback (no spaced education), improve competence as measured by the certification examination? In building this proposal for a definitive trial, the investigators have support from coast to coast. In addition to key clinician educators, the team includes knowledge users from the organization responsible for the certification examination in Family Medicine, methodologists and experienced researchers who study how mobile apps can promote engagement with clinical information. The team has the right blend of expertise in medical education and cluster randomized trials.

Approach and Methods: The investigators will follow an organizational participatory research approach, and propose a cluster randomized controlled trial. Setting: All incoming family medicine residents in Canada will be eligible to participate. Intervention site residents will receive alerts through an app to adaptively reinforce the learning of clinical content based on cases and test questions (spaced education). Residents in the control group will receive the same app providing identical clinical cases and test questions-on-demand, but with alerts inactivated (no spaced education). The primary outcome will be scores on the certification examination. This routinely collected data will be provided to the team by the College of Family Physicians of Canada.

Expected Results and Conclusion: Spaced education will improve examination scores. This will inform educational practice by providing evidence to optimize the training of residents.

02

Conditions studied

  • Behavior

Browse trials for

03

In context

Behavior

1,573 studies on the registry are indexed under Behavior; 313 are open to participants now.

This study's enrollment of 634 is above the median of 120 across 1,197 interventional studies indexed under Behavior.

Browse Behavior studies →

Lead sponsor

Jewish General Hospital is the lead sponsor of 97 studies on the registry; 11 are open to participants now.

Counted across the registry records on this site, refreshed daily.

04

Who can participate

Ages eligible
Child (0–17), Adult (18–64), Older adult (65+)
Sexes eligible
All
Accepts healthy volunteers
Yes

Go through the criteria one by one — yes, no or not sure — and take the list to your doctor or the study team. Kept in this browser only.

Inclusion criteria

  • incoming family medicine residents in Canada (July 2017)

Exclusion criteria

Exclusion Criteria:

  • not a family medicine resident
  • did not start residency on July 1, 2017
05

Study design

Phase
Not applicable
Primary purpose
Other
Allocation
Randomized
Intervention model
Parallel assignment
Masking
Double (Participant, Investigator)
Enrollment
634 participants (actual)

Study arms

  • Experimental
    Intervention

    Intervention site residents will receive alerts through an app to adaptively reinforce the learning of clinical content based on cases and test questions (spaced education).

    Behavioral: Spaced educational intervention

  • No intervention
    Control

    Residents in the control group will receive the same app providing identical clinical cases and test questions-on-demand, but with alerts inactivated (no spaced education).

Interventions

  • BehavioralSpaced educational intervention

    A spaced educational intervention will be provided to participants

06

What researchers measure

Primary outcomes

  1. Scores on the Certification Examination

    This is the score on the written component of the examination of the College of Family Physicians of Canada. This refers to the grade/score given to participants on the Short Answer Management Problems (SAMP) section of the exam ranging from 0 to 100. Higher values represent a better outcome. The score minimum observed was 53.9 and max is 84.4 for this study.

    Time frame: 2 years

07

Results

Posted Feb 12, 2021

Participant flow

Participant flow — Overall Study
MilestoneInterventionControl
Started335299
Completed281241
Not completed5458
Withdrew: Never signed in to access the app5458

Outcome measures

PrimaryScores on the Certification Examination

This is the score on the written component of the examination of the College of Family Physicians of Canada. This refers to the grade/score given to participants on the Short Answer Management Problems (SAMP) section of the exam ranging from 0 to 100. Higher values represent a better outcome. The score minimum observed was 53.9 and max is 84.4 for this study.

Time frame:
2 years
Reported as:
Mean · scores on a scale
Scores on the Certification Examination
scores on a scaleInterventionControl
Scores on the Certification Examination73.9 ± 4.473.1 ± 5.1

Adverse events

Collected over Adverse Events were not monitored/assessed.. Non-serious events are listed at a 0% frequency threshold.

Adverse event summary by group
GroupDeathsSeriousOther
Intervention———
Control———

Baseline characteristics

Age, Categorical
Age, Categorical(Participants)InterventionControlTotal
<=18 years000
Between 18 and 65 years335299634
>=65 years000
Sex: Female, Male
Sex: Female, Male(Participants)InterventionControlTotal
Disclosed gender (included 6 undisclosed in male intervention count) — Female229210439
Disclosed gender (included 6 undisclosed in male intervention count) — Male10689195
Ethnicity (NIH/OMB)
Ethnicity (NIH/OMB)(Participants)InterventionControlTotal
Hispanic or Latino000
Not Hispanic or Latino000
Unknown or Not Reported335299634
Region of Enrollment
Region of Enrollment(participants)InterventionControlTotal
Canada335299634
Smart phone
Smart phone(Participants)InterventionControlTotal
Count of participants234213447
International Medical Graduate
International Medical Graduate(Participants)InterventionControlTotal
Count of participants405797
Graduate degree
Graduate degree(Participants)InterventionControlTotal
Count of participants8066146
08

Study locations

1 site
  • McGill University
    Montréal, Quebec, Canada
09

References and documents

Study documents

PDFs hosted by the registry, ClinicalTrials.gov.

10

Timeline

Tracking since Sep 25, 2026
ElapsedEstimatedEstimated, not yet reachedSimilar studies: half by the dot; the band is the middle halfHalf of similar studies reached it by the dot; the band is the middle half, from a quarter to three quarters

Ran from Oct 2017 to primary completion in May 2019, 19 months.

Results were first posted in Feb 2021, 1 year 8 months after primary completion.

Of 741 non-industry interventional studies with no phase under Behavior, half reached primary completion within 14 months of starting (the median), counting those still running; a quarter within 5 and three quarters within 32. This study's 19 months is above that.

Counting every sponsor, half of 757 studies reached it within 13 months; a quarter within 5 and three quarters within 32.

How these figures are worked out, and which studies are left out of them.

Registered
Oct 6, 2017
First posted
Oct 17, 2017
StartActual
Oct 18, 2017
Primary completionActual
May 31, 2019
CompletionActual
Jul 1, 2019
Results first posted
Feb 12, 2021
Last update
Feb 12, 2021
What these dates mean
Start.
When the first participant enrolled; while estimated, when the study expects to open to recruitment.
Primary completion.
When the last participant was examined or treated to collect data for the study's main question, its primary outcome. A study that stopped early gives the date its data collection stopped.
Completion.
When the last participant's last visit took place, for every outcome, secondary ones and side effects included: the end of the study. Often later than primary completion, sometimes the same day.
Actual and Est.
Actual means the registry says the date has happened. Est. (estimated) is a date the sponsor plans or expects. It can still move, and the sponsor is expected to change it to actual once it has passed.
No changes since tracking began. The registry record was last updated on Feb 12, 2021, before this site started recording changes on Sep 25, 2026. Its history is on ClinicalTrials.gov ↗
11

Registry details

Key details

Study ID
NCT03312218
Lead sponsor
Jewish General Hospital
Collaborators
Western University, Canada, College of Family Physicians of Canada, Memorial University of Newfoundland, Université de Montréal, University of Ottawa, Queen's University, Kingston, Ontario, University of Toronto, McMaster University, University of British Columbia, University of Alberta, Université de Sherbrooke, University of Calgary
Responsible party
Roland Grad (Associate Professor, McGill University Dept. of Family Medicine, Director of the Clinician Scholar Program, Jewish General Hospital) — Principal investigator
First posted
Oct 17, 2017
Start date
Oct 18, 2017
Primary completion
May 31, 2019
Completion
Jul 1, 2019
Results posted
Feb 12, 2021
Last update
Feb 12, 2021

Oversight

Data monitoring committee
No
FDA-regulated drug
No
FDA-regulated device
No
View the source record on ClinicalTrials.gov ↗

Not currently enrolling

This study is completed, as verified in Jan 2021. You cannot join it, but the record below documents what was studied.

Follow this study

Get an email when the registry record changes — status, dates, results — or when someone posts here.

Sign in to follow

Discussion

Questions and observations about this study, from anyone following it. Not medical advice, and not a channel to the study team — their contact details are on the registry record.

Sign in to join the discussion. Reading takes no account; posting does. You choose a display name, and a pseudonym is the default.

Nothing here yet. If you are running this trial, taking part in it, or weighing whether to, this is the place to say so.

Start the discussion