Little overlap between surgical M&M and AHRQ on adverse events

Limited overlap in adverse events identified by surgical morbidity and mortality (M&M) conferences and by Agency for Healthcare Research and Quality patient safety indicators (PSIs) demonstrates that the two processes tend to capture different, but equally important, measures, according to study results published in the Journal of the American College of Surgeons.

monkeybusinessimages/Thinkstock

Just 18 of 149 (12.1%) PSI-defined events were identified by both processes in a retrospective, observational study of complications at the UC Davis Medical Center’s department of surgery. Most events (62.4%) were identified by only the M&M review, while 25.5% were identified by only the PSIs, reported Jamie E. Anderson, MD, MPH, of the department of surgery at UC Davis Medical Center in Sacramento and coauthors.

The study authors identified 6,563 surgical hospitalizations in the year 2016, of which 647 (9.9%) had at least one event that was either submitted for review for a departmental M&M conference, identified as a PSI event from administrative data, or both. Cases in patients aged less than 18 years were excluded.

Hospital administrative data were reported using ICD-10 CM/PCS codes. Investigators identified all PSI cases, which included pressure ulcer, retained surgical item, iatrogenic pneumothorax, central venous catheter–related blood stream infection, postoperative hip fracture, perioperative hematoma or hemorrhage requiring a procedure, postoperative acute kidney injury requiring dialysis, postoperative respiratory failure, perioperative pulmonary embolism or deep venous thrombosis, postoperative sepsis, postoperative wound dehiscence, and unrecognized abdominopelvic accidental puncture or laceration.

Complications submitted to the M&M conference were reviewed for PSI-defined events, and included events from general surgery, bariatric surgery, burn, cardiothoracic, colorectal, surgical oncology, plastic, vascular, transplant, and trauma. PSI-defined events were then reviewed to verify whether they counted as “true” PSI events and further classified as a documentation error, intentional exclusion, or inherent limitation of the PSI, the authors reported.

Of 6,563 surgical hospitalizations, 647 had at least one complication identified by M&M, PSI, or both. Of these, 116 had at least one PSI-defined event identified by either M&M or PSI. The remaining hospitalizations had unrelated complications and were excluded from analysis.

Of the 116 hospitalizations, there were 149 PSI-defined events, of which 18 (12.1%) were identified by both methods. Most events (62.4%) were identified by only the M&M review, and 25.5% were identified by only the PSIs. Perioperative hemorrhage/hematoma and postoperative sepsis were most likely to be identified by both.

Of the 93 PSI-defined events captured by only M&M, 11 (11.8%) met AHRQ criteria and were considered “true” events, or “false negatives.” All 38 events identified by PSI alone were correctly identified as true PSI events, Dr. Anderson and colleagues reported.

The findings indicate that the AHRQ PSI and surgical M&M conference “should be considered complementary approaches for identifying complications,” the authors wrote.

The PSI data captured central venous catheter–related blood stream infection and pressure ulcers, but the M&M conferences did not include these outcomes. The M&M reviewed more cases of postoperative sepsis, abdominopelvic accidental laceration, and the one case of retained surgical item.

“These two processes of identifying complications have different purposes, and each approach captured different events,” they added.

The M&M conference “balances clinician education and quality improvement with an underlying theme of accountability,” they said, with increased emphasis on examining adverse events in the context of systems-based practices. PSI, on the other hand, is intended as a “resource-nonintensive means” to help hospitals identify preventable events and facilitate quality improvement, they said.

“In an era in which there are numerous mechanisms to measure surgical quality, the traditional M&M conference is still relevant for identifying and discussing surgical complications,” the authors concluded. “We believe that our center’s existing M&M case-finding process is fundamentally sound, but it could be improved by including all PSI-flagged hospitalizations in our M&M process. This may result in review of some false-positive records, but it will enable our department to address certain potentially preventable complications that are currently overlooked.”

Two of the study coauthors received salary support from the AHRQ to support the agency’s Quality Indicator Program, one of whom serves on the agency’s Quality Indicators Expert Workgroup. No other disclosures were reported.

SOURCE: Anderson J et al. J Am Coll Surg. 2018 Jul 5. doi: 10.1016/j.jamcollsurg.2018.06.008.

Limited overlap in adverse events identified by surgical morbidity and mortality (M&M) conferences and by Agency for Healthcare Research and Quality patient safety indicators (PSIs) demonstrates that the two processes tend to capture different, but equally important, measures, according to study results published in the Journal of the American College of Surgeons.

monkeybusinessimages/Thinkstock

Just 18 of 149 (12.1%) PSI-defined events were identified by both processes in a retrospective, observational study of complications at the UC Davis Medical Center’s department of surgery. Most events (62.4%) were identified by only the M&M review, while 25.5% were identified by only the PSIs, reported Jamie E. Anderson, MD, MPH, of the department of surgery at UC Davis Medical Center in Sacramento and coauthors.

The study authors identified 6,563 surgical hospitalizations in the year 2016, of which 647 (9.9%) had at least one event that was either submitted for review for a departmental M&M conference, identified as a PSI event from administrative data, or both. Cases in patients aged less than 18 years were excluded.

Hospital administrative data were reported using ICD-10 CM/PCS codes. Investigators identified all PSI cases, which included pressure ulcer, retained surgical item, iatrogenic pneumothorax, central venous catheter–related blood stream infection, postoperative hip fracture, perioperative hematoma or hemorrhage requiring a procedure, postoperative acute kidney injury requiring dialysis, postoperative respiratory failure, perioperative pulmonary embolism or deep venous thrombosis, postoperative sepsis, postoperative wound dehiscence, and unrecognized abdominopelvic accidental puncture or laceration.

Complications submitted to the M&M conference were reviewed for PSI-defined events, and included events from general surgery, bariatric surgery, burn, cardiothoracic, colorectal, surgical oncology, plastic, vascular, transplant, and trauma. PSI-defined events were then reviewed to verify whether they counted as “true” PSI events and further classified as a documentation error, intentional exclusion, or inherent limitation of the PSI, the authors reported.

Of 6,563 surgical hospitalizations, 647 had at least one complication identified by M&M, PSI, or both. Of these, 116 had at least one PSI-defined event identified by either M&M or PSI. The remaining hospitalizations had unrelated complications and were excluded from analysis.

Of the 116 hospitalizations, there were 149 PSI-defined events, of which 18 (12.1%) were identified by both methods. Most events (62.4%) were identified by only the M&M review, and 25.5% were identified by only the PSIs. Perioperative hemorrhage/hematoma and postoperative sepsis were most likely to be identified by both.

Of the 93 PSI-defined events captured by only M&M, 11 (11.8%) met AHRQ criteria and were considered “true” events, or “false negatives.” All 38 events identified by PSI alone were correctly identified as true PSI events, Dr. Anderson and colleagues reported.

The findings indicate that the AHRQ PSI and surgical M&M conference “should be considered complementary approaches for identifying complications,” the authors wrote.

The PSI data captured central venous catheter–related blood stream infection and pressure ulcers, but the M&M conferences did not include these outcomes. The M&M reviewed more cases of postoperative sepsis, abdominopelvic accidental laceration, and the one case of retained surgical item.

“These two processes of identifying complications have different purposes, and each approach captured different events,” they added.

The M&M conference “balances clinician education and quality improvement with an underlying theme of accountability,” they said, with increased emphasis on examining adverse events in the context of systems-based practices. PSI, on the other hand, is intended as a “resource-nonintensive means” to help hospitals identify preventable events and facilitate quality improvement, they said.

“In an era in which there are numerous mechanisms to measure surgical quality, the traditional M&M conference is still relevant for identifying and discussing surgical complications,” the authors concluded. “We believe that our center’s existing M&M case-finding process is fundamentally sound, but it could be improved by including all PSI-flagged hospitalizations in our M&M process. This may result in review of some false-positive records, but it will enable our department to address certain potentially preventable complications that are currently overlooked.”

Two of the study coauthors received salary support from the AHRQ to support the agency’s Quality Indicator Program, one of whom serves on the agency’s Quality Indicators Expert Workgroup. No other disclosures were reported.

SOURCE: Anderson J et al. J Am Coll Surg. 2018 Jul 5. doi: 10.1016/j.jamcollsurg.2018.06.008.

Limited overlap in adverse events identified by surgical morbidity and mortality (M&M) conferences and by Agency for Healthcare Research and Quality patient safety indicators (PSIs) demonstrates that the two processes tend to capture different, but equally important, measures, according to study results published in the Journal of the American College of Surgeons.

monkeybusinessimages/Thinkstock

Just 18 of 149 (12.1%) PSI-defined events were identified by both processes in a retrospective, observational study of complications at the UC Davis Medical Center’s department of surgery. Most events (62.4%) were identified by only the M&M review, while 25.5% were identified by only the PSIs, reported Jamie E. Anderson, MD, MPH, of the department of surgery at UC Davis Medical Center in Sacramento and coauthors.

The study authors identified 6,563 surgical hospitalizations in the year 2016, of which 647 (9.9%) had at least one event that was either submitted for review for a departmental M&M conference, identified as a PSI event from administrative data, or both. Cases in patients aged less than 18 years were excluded.

Hospital administrative data were reported using ICD-10 CM/PCS codes. Investigators identified all PSI cases, which included pressure ulcer, retained surgical item, iatrogenic pneumothorax, central venous catheter–related blood stream infection, postoperative hip fracture, perioperative hematoma or hemorrhage requiring a procedure, postoperative acute kidney injury requiring dialysis, postoperative respiratory failure, perioperative pulmonary embolism or deep venous thrombosis, postoperative sepsis, postoperative wound dehiscence, and unrecognized abdominopelvic accidental puncture or laceration.

Complications submitted to the M&M conference were reviewed for PSI-defined events, and included events from general surgery, bariatric surgery, burn, cardiothoracic, colorectal, surgical oncology, plastic, vascular, transplant, and trauma. PSI-defined events were then reviewed to verify whether they counted as “true” PSI events and further classified as a documentation error, intentional exclusion, or inherent limitation of the PSI, the authors reported.

Of 6,563 surgical hospitalizations, 647 had at least one complication identified by M&M, PSI, or both. Of these, 116 had at least one PSI-defined event identified by either M&M or PSI. The remaining hospitalizations had unrelated complications and were excluded from analysis.

Of the 116 hospitalizations, there were 149 PSI-defined events, of which 18 (12.1%) were identified by both methods. Most events (62.4%) were identified by only the M&M review, and 25.5% were identified by only the PSIs. Perioperative hemorrhage/hematoma and postoperative sepsis were most likely to be identified by both.

Of the 93 PSI-defined events captured by only M&M, 11 (11.8%) met AHRQ criteria and were considered “true” events, or “false negatives.” All 38 events identified by PSI alone were correctly identified as true PSI events, Dr. Anderson and colleagues reported.

The findings indicate that the AHRQ PSI and surgical M&M conference “should be considered complementary approaches for identifying complications,” the authors wrote.

The PSI data captured central venous catheter–related blood stream infection and pressure ulcers, but the M&M conferences did not include these outcomes. The M&M reviewed more cases of postoperative sepsis, abdominopelvic accidental laceration, and the one case of retained surgical item.

“These two processes of identifying complications have different purposes, and each approach captured different events,” they added.

The M&M conference “balances clinician education and quality improvement with an underlying theme of accountability,” they said, with increased emphasis on examining adverse events in the context of systems-based practices. PSI, on the other hand, is intended as a “resource-nonintensive means” to help hospitals identify preventable events and facilitate quality improvement, they said.

“In an era in which there are numerous mechanisms to measure surgical quality, the traditional M&M conference is still relevant for identifying and discussing surgical complications,” the authors concluded. “We believe that our center’s existing M&M case-finding process is fundamentally sound, but it could be improved by including all PSI-flagged hospitalizations in our M&M process. This may result in review of some false-positive records, but it will enable our department to address certain potentially preventable complications that are currently overlooked.”

Two of the study coauthors received salary support from the AHRQ to support the agency’s Quality Indicator Program, one of whom serves on the agency’s Quality Indicators Expert Workgroup. No other disclosures were reported.

SOURCE: Anderson J et al. J Am Coll Surg. 2018 Jul 5. doi: 10.1016/j.jamcollsurg.2018.06.008.