Quality Assurance in EMS: Measuring, Improving, and Sustaining Excellence

“A patient may have been sedated and paralyzed, intubated and placed on a ventilator, received inotropes, chrono-tropes, beta-blockers, opiates, or benzodiazepines…In all respects the entire course of prehospital medicine is critical to the hospital medical record and the continuity of care. Yet the entire system is built without integrated functionality. In today’s technological environment we must ask how this is even comprehendible or tolerable? “S. Rinaldi, NRP

Quality in Prehospital Care

Quality in prehospital emergency medical service's means providing the right care, to the right patient, at the right time, in the right way consistently. Sound familiar? This should remind you of the "rights" of medication administration: the right patient; drug; dose; time; and route. The operating environment and construct of EMS presents hurdles to quality measurement, feedback and improvement. Although like hospitals EMS agencies may be familiar with and can adopt frameworks such as Baldrige Model, Six Sigma, and PDSA (Plan-Do-Study-Act) implementing and maintaining these models can be challenging. Many agencies lack dedicated resources, do not consistently receive patient outcome feedback from hospitals and lack funding sources to sustain these programs.

The Institute of Medicine (IOM) defines quality across six dimensions, all of which are applicable to EMS. These include safety; effectiveness; efficiency; timeliness; patient-centeredness and equitability. Standard prehospital documentation captures some necessary data, presenting condition, working diagnosis, interventions, drug timing, dosing and similar. The PCR also includes other data such as vital signs, laboratory results, medication listings and observations.

Measuring to Manage

A maxim of operational leadership is that one cannot manage what they can't or don't measure. We tend to focus on the wrong metrics and measures and use untoward outcome awareness as the trigger for investigation and improvement. This is a reactive versus proactive approach and assures that between mitigation and improvement there is a harmed patient or an untoward outcome. We must do better as a delivery system to mandate and assure consistent quality of care. Doing so will require a deviation from measurements that are commonly used in EMS such as response time, turnaround time, transport time and similar. The most important measure of time is likely the time from injury/complaint to definitive care. An EMS agency may have arrived quickly in a system with the fastest response rates. But if their patient care is not up to par, or their outcomes weak why would arriving quickly matter?

Time from insult to care would align with the golden hour, tPA administration cycles, neurologic compromise in cases of TBI, venom absorption in cases of snake bite and similar. Many organizations also measure protocol compliance, which is often viewed as a risk management metric as opposed to a quality metric. It is important to align protocol compliance with licensure, scope of practice, and operation within clinically approved pathways. However, a Paramedic could be grossly compliant with protocol adherence, and woefully inadequate at patient care.

I am making an argument that all EMS agencies should reconsider what is measured and contemplate whether the list below should be part of the conversation.

• Field to ED Diagnosis Match Rate: A definitive clinical diagnosis requires a physician and often additional testing that is not available in the field. But a Paramedic is most certainly establishing a working diagnosis with every patient they encounter, often working from the history. To apply a protocol, the Paramedic needs an idea of what is going on; is it asthma or COPD, CHF or STEMI, infection or sepsis, stroke or hypoglycemia. Measuring whether the working diagnosis was correct relative to treatment pathway would help understand competency and quality.
• Alert Positive Predictive Value (PPV): The accuracy rate of prehospital activations for STEMI, Stroke and Trauma. A high PPV means the hospital team were activated appropriately, a low rate indicates otherwise.
• Triage: Many patients are over-triaged or under-triaged and could have been transported or directed to alternative sites. Measuring the accuracy of triage decisions can provide insightful data.
• Pain Score Reduction: Percentage of patients who experience a documented, clinically significant reduction in pain scale from the time of EMS encounter to hospital transfer of care.
• Discharge: Survival to hospital discharge in cases of cardiac arrest of severe trauma. Field ROSC is a win, but not a measure of success overall.
• Neurologically Intact Survival (CPC): For cardiac arrest patients who survive, measuring their cerebral performance category at discharge to evaluate brain function recovery.
• Readmission Rate: In systems with mobile integrated healthcare or community paramedicine programs, tracking if prehospital interventions successfully kept high risk patients from returning to the emergency department within 30 days.
• Paramedic Fatigue: Number of hours worked per paramedic per week across all jobs. Number of consecutive hours worked. We would not want our surgeon operating after being up for 36 hours or on their 100th hour of work. This is why residency program maximum work hours were amended years ago – because we know that mistakes happen when we are exhausted. Yet we are perfectly accepting of our Paramedics working two or three jobs and consistently 80-100 hours a week. This is fully unacceptable.

As care has shifted to new models – including community paramedicine and mobile integrated health care the need for quality measurement has increased. These programs are often operated by integrated health networks (IDNs) or hospital systems and measuring, monitoring and mitigating quality data is a critical part of the standard operation. The Institute of Medicine in 1999 published "To Err is Human: Building a Safer Health System" and made quality a priority many years ago. No where in this document is EMS or prehospital care even mentioned. It is the oversight that has always existed; EMS being a necessary and critical component of healthcare delivery, but always in the shadows and never the spotlight. For the profession to advance during a period of evolutionary care, we must grow in many ways: education, licensure, compensation – and among all quality.

I had the privilege of training and working in an EMS system and protocol environment that was among the most progressive and encompassing in the Country. In doing so, our medical directors and our agency held us to very high standards of outcomes, clinical expertise and patient care. Skills were drilled and reinforced, regular medical continuing education was necessary and quality was measured. But not all systems operate this way. I would argue that all should.

Quality Management and PDSA

Quality management and measurement is a function of operating cycles the world over. Vehicle production facilities measure build quality, chip manufacturers measure silicon purity, GE famously measures variation via six sigma, Toyota via kaizen, others via LEAN. Regardless of the tool, all are trying to achieve something similar – predictable consistent repeatable outcomes with the lowest level of untoward outcome. This is exactly what healthcare seeks to achieve. One way to do so is via the Plan-Do-Study-Act (PDSA) cycle, also called Deming's Cycle. This simple four-step process drives continuous improvement across healthcare systems worldwide. EMS agencies that embrace PDSA see dramatic improvements in outcomes.

• PLAN: Identify a problem. Analyze root causes. Design a small test of change. Set specific, measurable aims. Example: 'Our STEMI-to-PCI time exceeds target. We'll test a direct-to-cath-lab protocol for BIBA patients with anterior STEMIs.'
• DO: Run the test with a small group (one ambulance crew, one shift) over a defined period (2–4 weeks). Collect data. Document what happens, not what should happen.
• STUDY: Analyze results against your baseline. Did door-to-balloon time improve? Did it create safety risks? Did crews accept it? Interview providers. Review data.
• ACT: Based on findings, adopt (standardize), adapt (modify), or abandon the change. Then cycle again.

The genius of PDSA is that it's rapid, low-risk, and data-driven. You don't bet the entire system on a new protocol; you test it first. Many EMS agencies run 20–30 PDSA cycles per year, continuously refining care. These are among the best quality EMS agencies in the country and include: Wake County EMS (North Carolina); King County EMS (Washington); MedStar Mobile (Texas) and Austin-Travis County (Texas). These agencies all share a common operational philosophy: prioritize clinical outcomes and data integration over traditional speed based operational metrics.

Operational Considerations

Data without feedback is noise. Improvement requires closing the loop—providers must see how their actions affect outcomes. A significant gap is often the lack of closed loop communication from the hospital providing an update on the patient outcome, final diagnosis and impact of pre-hospital interventions upon those outcomes. How many times have you transferred patient care at the hospital never to know what happened to the patient? Sure, sometimes you can check in after a subsequent transport, or you may catch wind from a colleague, but in general the feedback loop is incomplete. This is in part because Paramedics (see also licensure article on my Substack) are not consistently identified as providers – they are viewed and reimbursed as transporters. In the view of many hospitals why does the transporter need to know the patient outcome?

A robust system of measurement and feedback will include:

• Real-time feedback (on-scene quality coaching, immediate protocol corrections during calls). Paramedics won't like this, but immediate feedback and team challenge are hallmarks of quality medicine. In the same way the operating surgical team does a "time out", EMS needs to consider a scene care "time out" when appropriate.
• Peer feedback (fellow paramedics reviewing cases, case conferences, crew debriefs). We need to do this objectively and without bias.
• System feedback (monthly quality reports showing each crew's performance vs. agency target).
• Outcome feedback (sharing ROSC rates, survival-to-discharge data, or hearing from patients who survived thanks to EMS care).

EMS systems, like Wake County EMS and others as cited, use structured quality improvement programs and show measurable gains that provide demonstrable return on investment:

• Cardiac arrest ROSC rates improved by 20–40% within 2 years (Rea et al., 2017)
• Compliance with evidence-based protocols increased from 60% to >90% (Sasson et al., 2013)
• Medication errors decreased >50% via standardized PDSA cycles (Vilke et al., 2015)

Quality programs require investment, accountability via governance and a commitment to continuous performance improvement. Agencies that lack adequate resources, have high unmanageable call volume, have an inconsistently engaged medical director or have not hired an expert in quality management are not just disadvantaged; they are placing patient lives at risk.

Hospitals need to lean in and support this by helping create EMR integration and regular close-loop reporting. But even this won’t be easy. Enterprise electronic health record (EHR) systems like Epic and Oracle do not offer native prehospital modules for field documentation. Instead, they rely entirely upon standard interoperability capabilities such as HL7, direct secure messaging. The good news is that Epic can trigger an outbound HL7 ADT (Admission, Discharge, Transfer) message to EMS endpoint. Another hurdle is that ePCR systems use NEMSIS XML data schemes, where hospital systems use an alternative format protocol. A development oversight that continues to perpetuate the transport versus care mindset that faded in the 1970s.

Consider the full scope and scale of medication administration and clinical intervention that happens in the prehospital acute care environment. A patient may have been sedated, paralyzed and intubated, placed on a ventilator, received inotropes, chrono-tropes, beta-blockers, opiates, or benzodiazepines. The patient may have a surgical airway, chest tube, nasogastric tube, intraosseous IV access, been cardioverted, defibrillated or are being actively paced. The patient may have had a dislocation reduced, been extricated from a machine, or pulled from the water. In all respects the entire course of prehospital medicine is critical to the medical record and the continuity of care. Yet the entire system is built without integrated functionality. In today’s technological environment we must ask how this is even comprehendible or tolerable.

Conclusion: From Reactive to Proactive

Quality measurement in EMS is not aspirational; it is imperative. We have the tools, evidence and peer comparatives of agencies that are doing this well and making a difference. What we lack is adoption at scale.

The irony is stark: in 1999, the Institute of Medicine identified quality as foundational to healthcare safety, yet EMS, the gateway to the entire system, was absent from that conversation. Twenty-seven years later, we remain largely invisible in healthcare quality discussions. But invisibility is not neutrality. It is complicity. Every time we prioritize response time over outcome measurement, every time we accept paramedic fatigue as part of the job, every time we fail to close the loop with hospitals on patient outcomes, we accept a lower standard than every other healthcare discipline. If we continue to do so, licensure, wages and independence will remain elusive and unattainable.

This must change.

The path forward is clear. It begins not with massive infrastructure or unlimited budgets, but with leadership commitment to measurement and continuous improvement. Wake County, King County, MedStar, and Austin-Travis County prove that excellence is achievable even in resource-constrained environments when leadership prioritizes outcomes over speed metrics.

Start small. Pick one quality metric. One protocol. One PDSA cycle. Measure it. Share the results with your team. Ask your hospital for feedback on your patient outcomes. Close one feedback loop at a time. Over 12–18 months, momentum builds. Culture shifts. Providers begin to see themselves not as transporters, but as clinicians with measurable impact on patient outcomes.

Your patients deserve nothing less. Your profession deserves nothing less. The time to measure quality in EMS is not next year or when you have more resources. It is now.

References

• Rea, T. D., Crouthamel, J., Eisenberg, M. S., Becker, L. J., & Lima, A. R. (2017). Temporal trends in sudden cardiac arrest. Circulation, 136(2), 154–165.
• Sasson, C., Forman, J., Krass, D., Mears, G., & McNally, B. (2013). Prehospital termination of resuscitation in motor vehicle crash victims with blunt injuries. American Journal of Emergency Medicine, 31(9), 1342–1347.
• Vilke, G. M., Bozeman, W. P., & Chan, T. C. (2015). Medication errors during prehospital care in an urban EMS system. American Journal of Emergency Medicine, 33(6), 762–765.
• Institute of Medicine. (2001). Crossing the quality chasm: A new health system for the 21st century. National Academies Press.
• National Association of EMS Physicians (NAEMSP). (2022). EMS quality improvement toolkit. Retrieved from naemsp.org
• Deming, W. E. (1986). Out of the crisis. MIT Press.
• Institute for Healthcare Improvement (IHI). (2026). The Improvement Model. Retrieved from ihi.org