An interventional study of Independent planning and LLM-assisted planning in Simulation-based Nursing Care Planning, sponsored by Chimei Medical Center. Completed at 1 site in Taiwan. Open to participants aged 18 Years and older, including healthy volunteers. Per ClinicalTrials.gov, last updated 2026-11-18.
Sponsored by Chimei Medical Center · Not applicable, Interventional, and Health services research
Help build ClinicalTrials.gg — short surveys, remote interviews or testing, in your language. Take part →
This study evaluated whether assistance from a large language model (LLM), a type of artificial intelligence that generates text, improved the quality of nursing care plans and reduced the time needed to complete them.
The study included 120 registered nurses working in internal medicine wards, surgical wards, and intensive care units at a medical center in southern Taiwan. Nurses were randomly assigned to one of two groups:
Each nurse completed only the assigned workflow during a single study session. Participants completed a brief baseline questionnaire and prepared nursing problems, goals, and interventions for a standardized simulated clinical case. The diagnoses in the simulated cases were included for scenario purposes only; no patients were enrolled. Tasks were performed in a secure hospital test environment without real patient data.
Expert nurse raters who were not informed of group assignments independently evaluated the final care plans. The nursing care decision quality assessment had a maximum total score of 30 points, comprising decision-content quality (25 points) and decision-language quality (5 points). The system recorded task completion time.
Researchers compared the groups' final care-plan quality scores and task completion times.
Nursing care planning requires nurses to identify nursing problems, establish appropriate goals, and select feasible interventions. Large language models (LLMs) can generate draft text, but their contribution to nursing care-plan quality and task efficiency requires evaluation. In this study, nurses were responsible for reviewing the generated content and determining the final care plan.
Study design and setting
This single-center, parallel-group randomized controlled study compared Independent planning and LLM-assisted planning using standardized simulated clinical cases. The study was conducted in internal medicine wards, surgical wards, and intensive care units at a medical center in southern Taiwan.
Among 652 nurses who met the eligibility criteria and expressed willingness to participate, 120 were selected through stratified random sampling, with 40 nurses from each clinical setting. Within each setting, participants were individually randomized in a 1:1 ratio to Independent planning or LLM-assisted planning. Each group included 60 participants, comprising 20 nurses from each clinical setting. Excel-generated random-number procedures were used for sampling and allocation.
Each participant completed one assigned workflow during a single study session. The study used a posttest-only assessment of the submitted care plan; participants did not complete both study conditions.
Study procedures
Participants completed a brief baseline questionnaire and a care-planning task based on a standardized simulated clinical case relevant to their clinical setting. The standardized cases included a pneumonia case for the internal medicine setting, a cholelithiasis case for the surgical setting, and a pneumonia case for the intensive care setting. These diagnoses were included solely as features of the simulated scenarios; no patients were enrolled or treated. The study evaluated nurses' care-planning performance, not patient outcomes. All tasks were performed in a secure hospital test environment separated from routine clinical systems. No real patient data were used, and no audio or video recordings were made.
In the Independent planning group, participants independently prepared nursing problems, goals, and interventions, reviewed their work, and submitted a final care plan without LLM assistance.
In the LLM-assisted planning group, participants entered prompts based on the simulated case to obtain an LLM-generated draft. They reviewed the draft, corrected or removed inappropriate content, added information as needed, and submitted a final care plan. Participants retained responsibility for the final nursing problems, goals, and interventions.
Outcome assessment
The primary outcomes were expert-rated nursing care decision quality and total task completion time.
The nursing care decision quality assessment had a maximum total score of 30 points, comprising decision-content quality, with a maximum of 25 points, and decision-language quality, with a maximum of 5 points. Expert nurse raters independently evaluated the final submitted care plans without being informed of participants' group assignments. Higher scores indicated better assessed quality. Inter-rater reliability was assessed.
Task completion time was calculated from system-recorded task-start and final-submission timestamps. The same timing boundaries applied to both groups. For LLM-assisted planning, the task interval included prompt entry, LLM processing, and participant review and revision.
Secondary outcomes were textual overlap and semantic similarity between each participant's final care plan and the expert consensus reference for the same simulated case, assessed using ROUGE-L and BERTScore, respectively. These measures were calculated offline from the submitted text.
The protocol also specified AI-only outputs as supplementary algorithmic benchmarks. These outputs were separate from the randomized comparison and did not constitute an additional participant group or contribute to enrollment.
Data protection
Study questionnaires, care-plan texts, ratings, and workflow timestamps were linked using study codes. Research data were stored on secure institutional systems with access restricted to authorized study personnel. Identifiable information was not included in the simulated cases submitted to the LLM. Data retention and destruction followed the approved study protocol and institutional requirements.
Chimei Medical Center is the lead sponsor of 28 studies on the registry; 6 are open to participants now.
Counted across the registry records on this site, refreshed daily.
Go through the criteria one by one — yes, no or not sure — and take the list to your doctor or the study team. Kept in this browser only.
Exclusion Criteria:
Underlined terms in the criteria open these too. Explained by clinicaltrials.gg, not part of the registry record. The study team decides who can take part.
Before you join, the study team explains what taking part involves — its purpose, what happens, the risks and possible benefits — and answers your questions, so you can decide freely. Consent is usually recorded on a form (the informed consent form, ICF) signed by you or, where the law allows, by someone legally authorized to decide for you.
You can keep asking questions during the study, you are told of new information that matters, and you can choose to leave at any time.
Informed consent
Before you join, the study team explains what taking part involves — its purpose, what happens, the risks and possible benefits — and answers your questions, so you can decide freely. Consent is usually recorded on a form (the informed consent form, ICF) signed by you or, where the law allows, by someone legally authorized to decide for you.
You can keep asking questions during the study, you are told of new information that matters, and you can choose to leave at any time.
Explained by clinicaltrials.gg, not part of the registry record. The study team decides who can take part.
Participants independently prepare a nursing care plan for a standardized simulated clinical case, including nursing problems, goals, and interventions. They review and revise their own work before submitting the final care plan. No LLM assistance or AI-generated suggestions are used.
Other: Independent planning
Participants prepare a nursing care plan for a standardized simulated clinical case with LLM assistance. They enter prompts to obtain an LLM-generated draft, review and revise the draft, and submit the final nursing problems, goals, and interventions. Participants remain responsible for the content of the final care plan.
Other: LLM-assisted planning
A single-session care-planning task performed in a secure hospital test environment. Participants review the simulated case and independently formulate, review, and submit nursing problems, goals, and interventions using their nursing knowledge and judgment, without LLM assistance.
A single-session care-planning task performed in a secure hospital test environment. Participants enter prompts based on the simulated case to obtain an LLM-generated draft of nursing problems, goals, and interventions. They evaluate the draft, correct or remove inappropriate content, add information as needed, and submit a final care plan. Only simulated case information is used; no real patient data are entered.
Expert-rated nursing care decision quality (six-item total score)
The final nursing care plan for a standardized simulated clinical case is independently assessed by three expert nurse raters blinded to group assignment, using a study-specific six-item rating instrument. Five items assess decision-content quality and one item assesses decision-language quality. Each item is scored from 1 to 5. The content subtotal ranges from 5 to 25, and the language score ranges from 1 to 5. For each rater, the six item scores are summed to obtain a total score ranging from 6 to 30. The participant-level score is the arithmetic mean of the three raters' total scores. Higher scores indicate better assessed nursing care decision quality.
Time frame: Posttest (at the end of the single simulation session; one assessment).
Total care-planning task completion time (seconds)
Total elapsed time, in seconds, from the start of the simulated care-planning task to submission of the final care plan, calculated from system-recorded start and submission timestamps. The same timing boundaries apply to both groups. Time includes case review, drafting, review, and revision. In the LLM-assisted planning group, it also includes prompt entry and LLM processing within the task interval. Lower values indicate shorter task completion time.
Time frame: During the single simulation session, from task start to final submission.
Textual overlap with an expert consensus reference (ROUGE-L)
ROUGE-L score comparing each participant's final submitted care plan with the expert consensus reference for the same simulated clinical case. The score quantifies textual overlap based on the longest common subsequence between the submitted text and the reference. Higher scores indicate greater textual overlap. Scores are calculated offline from the final care plans submitted after the assigned workflow.
Time frame: Posttest (based on the final care plan submitted at the end of the single simulation session; calculated offline).
Semantic similarity to an expert consensus reference (BERTScore)
BERTScore comparing each participant's final submitted care plan with the expert consensus reference for the same simulated clinical case. The score assesses semantic similarity using contextual text embeddings. Higher scores indicate greater semantic similarity under the specified model and calculation settings. Scores are calculated offline from the final care plans submitted after the assigned workflow.
Time frame: Posttest (based on the final care plan submitted at the end of the single simulation session; calculated offline).
Plan to share: No
No publications or documents are linked to this record.
Ran from May 2026 to primary completion in Jul 2026, 1 month.
Start moved once since we started tracking on Sep 25, 2026: Mar 2026 → May 2026, on Nov 18, 2026.
Earlier changes are on the record history on ClinicalTrials.gov ↗
How these figures are worked out, and which studies are left out of them.
From the registry record's own update history. This site started tracking changes on Sep 25, 2026; for anything earlier, see the record history on ClinicalTrials.gov ↗
This study is completed, as verified in Nov 2026. You cannot join it, but the record below documents what was studied.
Get an email when the registry record changes — status, dates, results — or when someone posts here.
Sign in to followQuestions and observations about this study, from anyone following it. Not medical advice, and not a channel to the study team — their contact details are on the registry record.
Sign in to join the discussion. Reading takes no account; posting does. You choose a display name, and a pseudonym is the default.
Nothing here yet. If you are running this trial, taking part in it, or weighing whether to, this is the place to say so.
Chimei Medical Center