A reliable rubric for evaluating medical apps

Article Type
Article
Changed
Wed, 05/19/2021 - 12:09
Author(s)
ACOG Presidential Task Force

To help ObGyns evaluate mobile apps for use in clinical practice, the American College of Obstetricians and Gynecologists Presidential Task Force of Dr. Eva Chalas recommends a quantitative rubric that was developed by the American Society of Health-System Pharmacists (ASHP) for evaluating drug information apps (TABLE).1 Criteria are graded on a point scale of 1 to 4, with 1 point indicating major deficiencies and 4 points indicating no deficiencies.

 

The ASHP used the following criteria in evaluating mobile apps:

  • Usefulness: the app’s overall usefulness in a particular practice setting
  • Accuracy: overall accuracy of the app should be thoroughly examined
  • Authority: it is critical to assess authority or authorship to determine that the developers are reputable, qualified, and authoritative enough to create the medical content in question
  • Objectivity: to determine if content is fair, balanced, and unbiased
  • Timeliness: given that medical information is continually changing, an app must be evaluated based on the timeliness of its content
  • Functionality: how the app downloads, deploys, and operates across devices and software platforms (that is, iOS, Android)
  • Design: well-designed apps are generally more user friendly and, therefore, useful. They should require minimal or no training and have easily discernible buttons, a clean and uncluttered format, consistent graphics layout, terminology appropriate for the intended audience, streamlined navigation without extraneous steps/gestures, appropriate-sized text, and sufficient white space to improve readability.
  • Security: Many apps collect a wide array of personal and device data. Collected data has the potential for being sold to third parties for marketing and advertising purposes. Apps should disclose their privacy policy and provide an explanation as to why personal data are being collected. If personal identifiable information (PII) is collected, then the app should be encrypted. If protected health information (PHI) is collected, the app must follow compliance with HIPAA/HITECH (Health Insurance Portability and Accountability Act/Health Information Technology for Economic and Clinical Health Act). Additionally, apps should not compromise the security or functionality of the mobile device being used.
  • Value: appropriateness of an app's cost. ●

 

References
  1. Hanrahan C, Aungst TD, Cole S. Evaluating mobile medical applications. American Society of Health-System Pharmacists eReports. https://www.ashp .org/-/media/store-files/mobile-medical-apps. ashx. Accessed January 22, 2021.
Article PDF
obgm03305029.pdf
Author and Disclosure Information

ACOG Presidential Task Force members

Nicholas Kulbida, MD, is Chair, Department
of Obstetrics and Gynecology, Ellis Medicine,
and Medical Director, Bellevue Woman’s Care
Center, Schenectady, New York, and OB
Hospitalist Group, Greenville, South Carolina.

Donna Montalto, MPP, is Chief of Staff and
SVP, Marketing and Communications, Optum
Tri-State, Westchester, New York.

Hartaj K. Powell, MD, MPH, is OB
Hospitalist, Ascension Saint Agnes Hospital,
Baltimore, Maryland.

Krista Wagoner, MD, is Assistant Professor
of Obstetrics and Gynecology, Director,
Clerkship in Obstetrics and Gynecology,
MUSC East Cooper Women’s Center, Medical
University of South Carolina, Charleston.

Richard Waldman, MD, is Chair,
Department of Ob/Gyn, St. Joseph’s
Hospital, and Partner, Associates for
Women’s Health, Syracuse, New York.

Matthew Wells, MD, MBA, is Attending
Physician, Women and Children’s Services,
NYU Langone Health Hospital, and Unified
Women’s Healthcare, Mineola, New York.

The authors report no financial relationships relevant to this article.

Issue
OBG Management - 33(5)
Publications
MDedge ObGyn
OBG Management
Topics
Practice Management
Page Number
29-30
Sections
Managing Your Practice
Author(s)
ACOG Presidential Task Force
Author(s)
ACOG Presidential Task Force
Author and Disclosure Information

ACOG Presidential Task Force members

Nicholas Kulbida, MD, is Chair, Department
of Obstetrics and Gynecology, Ellis Medicine,
and Medical Director, Bellevue Woman’s Care
Center, Schenectady, New York, and OB
Hospitalist Group, Greenville, South Carolina.

Donna Montalto, MPP, is Chief of Staff and
SVP, Marketing and Communications, Optum
Tri-State, Westchester, New York.

Hartaj K. Powell, MD, MPH, is OB
Hospitalist, Ascension Saint Agnes Hospital,
Baltimore, Maryland.

Krista Wagoner, MD, is Assistant Professor
of Obstetrics and Gynecology, Director,
Clerkship in Obstetrics and Gynecology,
MUSC East Cooper Women’s Center, Medical
University of South Carolina, Charleston.

Richard Waldman, MD, is Chair,
Department of Ob/Gyn, St. Joseph’s
Hospital, and Partner, Associates for
Women’s Health, Syracuse, New York.

Matthew Wells, MD, MBA, is Attending
Physician, Women and Children’s Services,
NYU Langone Health Hospital, and Unified
Women’s Healthcare, Mineola, New York.

The authors report no financial relationships relevant to this article.

Author and Disclosure Information

ACOG Presidential Task Force members

Nicholas Kulbida, MD, is Chair, Department
of Obstetrics and Gynecology, Ellis Medicine,
and Medical Director, Bellevue Woman’s Care
Center, Schenectady, New York, and OB
Hospitalist Group, Greenville, South Carolina.

Donna Montalto, MPP, is Chief of Staff and
SVP, Marketing and Communications, Optum
Tri-State, Westchester, New York.

Hartaj K. Powell, MD, MPH, is OB
Hospitalist, Ascension Saint Agnes Hospital,
Baltimore, Maryland.

Krista Wagoner, MD, is Assistant Professor
of Obstetrics and Gynecology, Director,
Clerkship in Obstetrics and Gynecology,
MUSC East Cooper Women’s Center, Medical
University of South Carolina, Charleston.

Richard Waldman, MD, is Chair,
Department of Ob/Gyn, St. Joseph’s
Hospital, and Partner, Associates for
Women’s Health, Syracuse, New York.

Matthew Wells, MD, MBA, is Attending
Physician, Women and Children’s Services,
NYU Langone Health Hospital, and Unified
Women’s Healthcare, Mineola, New York.

The authors report no financial relationships relevant to this article.

Article PDF
obgm03305029.pdf
Article PDF
obgm03305029.pdf

To help ObGyns evaluate mobile apps for use in clinical practice, the American College of Obstetricians and Gynecologists Presidential Task Force of Dr. Eva Chalas recommends a quantitative rubric that was developed by the American Society of Health-System Pharmacists (ASHP) for evaluating drug information apps (TABLE).1 Criteria are graded on a point scale of 1 to 4, with 1 point indicating major deficiencies and 4 points indicating no deficiencies.

 

The ASHP used the following criteria in evaluating mobile apps:

  • Usefulness: the app’s overall usefulness in a particular practice setting
  • Accuracy: overall accuracy of the app should be thoroughly examined
  • Authority: it is critical to assess authority or authorship to determine that the developers are reputable, qualified, and authoritative enough to create the medical content in question
  • Objectivity: to determine if content is fair, balanced, and unbiased
  • Timeliness: given that medical information is continually changing, an app must be evaluated based on the timeliness of its content
  • Functionality: how the app downloads, deploys, and operates across devices and software platforms (that is, iOS, Android)
  • Design: well-designed apps are generally more user friendly and, therefore, useful. They should require minimal or no training and have easily discernible buttons, a clean and uncluttered format, consistent graphics layout, terminology appropriate for the intended audience, streamlined navigation without extraneous steps/gestures, appropriate-sized text, and sufficient white space to improve readability.
  • Security: Many apps collect a wide array of personal and device data. Collected data has the potential for being sold to third parties for marketing and advertising purposes. Apps should disclose their privacy policy and provide an explanation as to why personal data are being collected. If personal identifiable information (PII) is collected, then the app should be encrypted. If protected health information (PHI) is collected, the app must follow compliance with HIPAA/HITECH (Health Insurance Portability and Accountability Act/Health Information Technology for Economic and Clinical Health Act). Additionally, apps should not compromise the security or functionality of the mobile device being used.
  • Value: appropriateness of an app's cost. ●

 

To help ObGyns evaluate mobile apps for use in clinical practice, the American College of Obstetricians and Gynecologists Presidential Task Force of Dr. Eva Chalas recommends a quantitative rubric that was developed by the American Society of Health-System Pharmacists (ASHP) for evaluating drug information apps (TABLE).1 Criteria are graded on a point scale of 1 to 4, with 1 point indicating major deficiencies and 4 points indicating no deficiencies.

 

The ASHP used the following criteria in evaluating mobile apps:

  • Usefulness: the app’s overall usefulness in a particular practice setting
  • Accuracy: overall accuracy of the app should be thoroughly examined
  • Authority: it is critical to assess authority or authorship to determine that the developers are reputable, qualified, and authoritative enough to create the medical content in question
  • Objectivity: to determine if content is fair, balanced, and unbiased
  • Timeliness: given that medical information is continually changing, an app must be evaluated based on the timeliness of its content
  • Functionality: how the app downloads, deploys, and operates across devices and software platforms (that is, iOS, Android)
  • Design: well-designed apps are generally more user friendly and, therefore, useful. They should require minimal or no training and have easily discernible buttons, a clean and uncluttered format, consistent graphics layout, terminology appropriate for the intended audience, streamlined navigation without extraneous steps/gestures, appropriate-sized text, and sufficient white space to improve readability.
  • Security: Many apps collect a wide array of personal and device data. Collected data has the potential for being sold to third parties for marketing and advertising purposes. Apps should disclose their privacy policy and provide an explanation as to why personal data are being collected. If personal identifiable information (PII) is collected, then the app should be encrypted. If protected health information (PHI) is collected, the app must follow compliance with HIPAA/HITECH (Health Insurance Portability and Accountability Act/Health Information Technology for Economic and Clinical Health Act). Additionally, apps should not compromise the security or functionality of the mobile device being used.
  • Value: appropriateness of an app's cost. ●

 

References
  1. Hanrahan C, Aungst TD, Cole S. Evaluating mobile medical applications. American Society of Health-System Pharmacists eReports. https://www.ashp .org/-/media/store-files/mobile-medical-apps. ashx. Accessed January 22, 2021.
References
  1. Hanrahan C, Aungst TD, Cole S. Evaluating mobile medical applications. American Society of Health-System Pharmacists eReports. https://www.ashp .org/-/media/store-files/mobile-medical-apps. ashx. Accessed January 22, 2021.
Issue
OBG Management - 33(5)
Issue
OBG Management - 33(5)
Page Number
29-30
Page Number
29-30
Publications
MDedge ObGyn
OBG Management
Publications
MDedge ObGyn
OBG Management
Topics
Practice Management
Article Type
Article
Sections
Managing Your Practice
Disallow All Ads
Content Gating
No Gating (article Unlocked/Free)
Alternative CME
Disqus Comments
Default
Eyebrow Default
ACOG PRESIDENTIAL TASK FORCE SERIES ON PREVENTIVE HEALTH CARE
Use ProPublica
Hide sidebar & use full width
render the right sidebar.
Conference Recap Checkbox
Not Conference Recap
Clinical Edge
Display the Slideshow in this Article
Medscape Article
Display survey writer
Reuters content
Disable Inline Native ads
WebMD Article
Article PDF Media
Subscribe to ACOG Presidential Task Force