Article Type
Changed
Wed, 06/14/2023 - 13:51

Medscape’s Editor-in-Chief Eric Topol, MD, referred to continual noninvasive, cuffless, accurate blood pressure devices as “a holy grail in sensor technology.”

He personally tested a cuff-calibrated, over-the-counter device available in Europe that claims to monitor daily blood pressure changes and produce data that can help physicians titrate medications.

Dr. Topol does not believe that it is ready for prime time. Yes, cuffless devices are easy to use, and generate lots of data. But are those data accurate?

Many experts say not yet, even as the market continues to grow and more devices are introduced and highlighted at high-profile consumer events.
 

Burned before

Limitations of cuffed devices are well known, including errors related to cuff size, patient positioning, patient habits or behaviors (for example, caffeine/nicotine use, acute meal digestion, full bladder, very recent physical activity) and clinicians’ failure to take accurate measurements.

But are the currently available cuffless devices acceptable substitutes?

Like many clinicians, Timothy B. Plante, MD, MHS, assistant professor at the University of Vermont Medical Center thrombosis & hemostasis program in Burlington, is very excited about cuffless technology. However, “we’ve been burned by it before,” he said in an interview.

Dr. Plante’s 2016 validation study of an instant blood pressure smartphone app found that its measurements were “highly inaccurate,” with such low sensitivity that more than three-quarters of individuals with hypertensive blood levels would be falsely reassured that their blood pressure was in the normal range.

His team’s 2023 review of the current landscape, which includes more sophisticated devices, concluded that accuracy remains an issue: “Unfortunately, the pace of regulation of these devices has failed to match the speed of innovation and direct availability to patient consumers. There is an urgent need to develop a consensus on standards by which cuffless BP devices can be tested for accuracy.”
 

Devices, indications differ

Cuffless devices estimate blood pressure indirectly. Most operate based on pulse wave analysis and pulse arrival time (PWA-PAT), explained Ramakrishna Mukkamala, PhD, in a commentary. Dr. Mukkamala is a professor in the departments of bioengineering and anesthesiology and perioperative medicine at the University of Pittsburgh.

PWA involves measuring a peripheral arterial waveform using an optical sensor such as the green lights on the back of a wrist-worn device, or a ‘force sensor’ such as a finger cuff or pressing on a smartphone. Certain features are extracted from the waveform using machine learning and calibrated to blood pressure values.

PAT techniques work together with PWA; they record the ECG and extract features from that signal as well as the arterial waveform for calibration to blood pressure values.

The algorithm used to generate the BP numbers comprises a proprietary baseline model that may include demographics and other patient characteristics. A cuff measurement is often part of the baseline model because most cuffless devices require periodic (typically weekly or monthly) calibration using a cuffed device.

Cuffless devices that require cuff calibration compare the estimate they get to the cuff-calibrated number. In this scenario, the cuffless device may come up with the same blood pressure numbers simply because the baseline model – which is made up of thousands of data points relevant to the patient – has not changed.

This has led some experts to question whether PWA-PAT cuffless device readings actually add anything to the baseline model.

They don’t, according to Microsoft Research in what Dr. Mukkamala and coauthors referred to (in a review published in Hypertension) as “a complex article describing perhaps the most important and highest resource project to date (Aurora Project) on assessing the accuracy of PWA and PWA devices.”

The Microsoft article was written for bioengineers. The review in Hypertension explains the project for clinicians, and concludes that, “Cuffless BP devices based on PWA and PWA-PAT, which are similar to some regulatory-cleared devices, were of no additional value in measuring auscultatory or 24-hour ambulatory cuff BP when compared with a baseline model in which BP was predicted without an actual measurement.”
 

 

 

IEEE and FDA validation

Despite these concerns, several cuffless devices using PWA and PAT have been cleared by the Food and Drug Administration.

Validating cuffless devices is no simple matter. The Institute of Electrical and Electronics Engineers published a validation protocol for cuffless blood pressure devices in 2014 that was amended in 2019 to include a requirement to evaluate performance in different positions and in the presence of motion with varying degrees of noise artifact.

However, Daichi Shimbo, MD, codirector of the Columbia Hypertension Center in New York and vice chair of the American Heart Association Statement on blood pressure monitoring, and colleagues point out limitations, even in the updated standard. These include not requiring evaluation for drift over time; lack of specific dynamic testing protocols for stressors such as exercise or environmental temperatures; and an unsuitable reference standard (oscillometric cuff-based devices) during movement.

Dr. Shimbo said in an interview that, although he is excited about them, “these cuffless devices are not aligned with regulatory bodies. If a device gives someone a wrong blood pressure, they might be diagnosed with hypertension when they don’t have it or might miss the fact that they’re hypertensive because they get a normal blood pressure reading. If there’s no yardstick by which you say these devices are good, what are we really doing – helping, or causing a problem?”

“The specifics of how a device estimates blood pressure can determine what testing is needed to ensure that it is providing accurate performance in the intended conditions of use,” Jeremy Kahn, an FDA press officer, said in an interview. “For example, for cuffless devices that are calibrated initially with a cuff-based blood pressure device, the cuffless device needs to specify the period over which it can provide accurate readings and have testing to demonstrate that it provides accurate results over that period of use.”

The FDA said its testing is different from what the Microsoft Aurora Project used in their study.

“The intent of that testing, as the agency understands it, is to evaluate whether the device is providing useful input based on the current physiology of the patient rather than relying on predetermined values based on calibration or patient attributes. We evaluate this clinically in two separate tests: an induced change in blood pressure test and tracking of natural blood pressure changes with longer term device use,” Mr. Kahn explained.

Analyzing a device’s performance on individuals who have had natural changes in blood pressure as compared to a calibration value or initial reading “can also help discern if the device is using physiological data from the patient to determine their blood pressure accurately,” he said.

Experts interviewed for this article who remain skeptical about cuffless BP monitoring question whether the numbers that appear during the induced blood pressure change, and with the natural blood pressure changes that may occur over time, accurately reflect a patient’s blood pressure.

“The FDA doesn’t approve these devices; they clear them,” Dr. Shimbo pointed out. “Clearing them means they can be sold to the general public in the U.S. It’s not a strong statement that they’re accurate.”
 

 

 

Moving toward validation, standards

Ultimately, cuffless BP monitors may require more than one validation protocol and standard, depending on their technology, how and where they will be used, and by whom.

And as Dr. Plante and colleagues write, “Importantly, validation should be performed in diverse and special populations, including pregnant women and individuals across a range of heart rates, skin tones, wrist sizes, common arrhythmias, and beta-blocker use.”

Organizations that might be expected to help move validation and standards forward have mostly remained silent. The American Medical Association’s US Blood Pressure Validated Device Listing website includes only cuffed devices, as does the website of the international scientific nonprofit STRIDE BP.

The European Society of Hypertension 2022 consensus statement on cuffless devices concluded that, until there is an internationally accepted accuracy standard and the devices have been tested in healthy people and those with suspected or diagnosed hypertension, “cuffless BP devices should not be used for the evaluation or management of hypertension in clinical practice.”

This month, ESH published recommendations for “specific, clinically meaningful, and pragmatic validation procedures for different types of intermittent cuffless devices” that will be presented at their upcoming annual meeting June 26.

Updated protocols from IEEE “are coming out soon,” according to Dr. Shimbo. The FDA says currently cleared devices won’t need to revalidate according to new standards unless the sponsor makes significant modifications in software algorithms, device hardware, or targeted patient populations.
 

Device makers take the initiative

In the face of conflicting reports on accuracy and lack of a robust standard, some device makers are publishing their own tests or encouraging validation by potential customers.

For example, institutions that are considering using the Biobeat cuffless blood pressure monitor watch “usually start with small pilots with our devices to do internal validation,” Lior Ben Shettrit, the company’s vice president of business development, said in an interview. “Only after they complete the internal validation are they willing to move forward to full implementation.”

Cardiologist Dean Nachman, MD, is leading validation studies of the Biobeat device at the Hadassah Ein Kerem Medical Center in Jerusalem. For the first validation, the team recruited 1,057 volunteers who did a single blood pressure measurement with the cuffless device and with a cuffed device.

“We found 96.3% agreement in identifying hypertension and an interclass correlation coefficient of 0.99 and 0.97 for systolic and diastolic measurements, respectively,” he said. “Then we took it to the next level and compared the device to ambulatory 24-hour blood pressure monitoring and found comparable measurements.”

The investigators are not done yet. “We need data from thousands of patients, with subgroups, to not have any concerns,” he says. “Right now, we are using the device as a general monitor – as an EKG plus heart rate plus oxygen saturation level monitor – and as a blood pressure monitor for 24-hour blood pressure monitoring.”

The developers of the Aktiia device, which is the one Dr. Topol tested, take a different perspective. “When somebody introduces a new technology that is disrupting something that has been in place for over 100 years, there will always be some grumblings, ruffling of feathers, people saying it’s not ready, it’s not ready, it’s not ready,” Aktiia’s chief medical officer Jay Shah, MD, noted.

“But a lot of those comments are coming from the isolation of an ivory tower,” he said.

Aktiia cofounder and chief technology officer Josep Solà said that “no device is probably as accurate as if you have an invasive catheter,” adding that “we engage patients to look at their blood pressure day by day. … If each individual measurement of each of those patient is slightly less accurate than a cuff, who cares? We have 40 measurements per day on each patient. The accuracy and precision of each of those is good.”

Researchers from the George Institute for Global Health recently compared the Aktiia device to conventional ambulatory monitoring in 41 patients and found that “it did not accurately track night-time BP decline and results suggested it was unable to track medication-induced BP changes.”

“In the context of 24/7 monitoring of hypertensive patients,” Mr. Solà said, “whatever you do, if it’s better than a sham device or a baseline model and you track the blood pressure changes, it’s a hundred times much better than doing nothing.”

Dr. Nachman and Dr. Plante reported no relevant financial relationships. Dr. Shimbo reported that he received funding from NIH and has consulted for Abbott Vascular, Edward Lifesciences, Medtronic, and Tryton Medical.

A version of this article first appeared on Medscape.com.

Publications
Topics
Sections

Medscape’s Editor-in-Chief Eric Topol, MD, referred to continual noninvasive, cuffless, accurate blood pressure devices as “a holy grail in sensor technology.”

He personally tested a cuff-calibrated, over-the-counter device available in Europe that claims to monitor daily blood pressure changes and produce data that can help physicians titrate medications.

Dr. Topol does not believe that it is ready for prime time. Yes, cuffless devices are easy to use, and generate lots of data. But are those data accurate?

Many experts say not yet, even as the market continues to grow and more devices are introduced and highlighted at high-profile consumer events.
 

Burned before

Limitations of cuffed devices are well known, including errors related to cuff size, patient positioning, patient habits or behaviors (for example, caffeine/nicotine use, acute meal digestion, full bladder, very recent physical activity) and clinicians’ failure to take accurate measurements.

But are the currently available cuffless devices acceptable substitutes?

Like many clinicians, Timothy B. Plante, MD, MHS, assistant professor at the University of Vermont Medical Center thrombosis & hemostasis program in Burlington, is very excited about cuffless technology. However, “we’ve been burned by it before,” he said in an interview.

Dr. Plante’s 2016 validation study of an instant blood pressure smartphone app found that its measurements were “highly inaccurate,” with such low sensitivity that more than three-quarters of individuals with hypertensive blood levels would be falsely reassured that their blood pressure was in the normal range.

His team’s 2023 review of the current landscape, which includes more sophisticated devices, concluded that accuracy remains an issue: “Unfortunately, the pace of regulation of these devices has failed to match the speed of innovation and direct availability to patient consumers. There is an urgent need to develop a consensus on standards by which cuffless BP devices can be tested for accuracy.”
 

Devices, indications differ

Cuffless devices estimate blood pressure indirectly. Most operate based on pulse wave analysis and pulse arrival time (PWA-PAT), explained Ramakrishna Mukkamala, PhD, in a commentary. Dr. Mukkamala is a professor in the departments of bioengineering and anesthesiology and perioperative medicine at the University of Pittsburgh.

PWA involves measuring a peripheral arterial waveform using an optical sensor such as the green lights on the back of a wrist-worn device, or a ‘force sensor’ such as a finger cuff or pressing on a smartphone. Certain features are extracted from the waveform using machine learning and calibrated to blood pressure values.

PAT techniques work together with PWA; they record the ECG and extract features from that signal as well as the arterial waveform for calibration to blood pressure values.

The algorithm used to generate the BP numbers comprises a proprietary baseline model that may include demographics and other patient characteristics. A cuff measurement is often part of the baseline model because most cuffless devices require periodic (typically weekly or monthly) calibration using a cuffed device.

Cuffless devices that require cuff calibration compare the estimate they get to the cuff-calibrated number. In this scenario, the cuffless device may come up with the same blood pressure numbers simply because the baseline model – which is made up of thousands of data points relevant to the patient – has not changed.

This has led some experts to question whether PWA-PAT cuffless device readings actually add anything to the baseline model.

They don’t, according to Microsoft Research in what Dr. Mukkamala and coauthors referred to (in a review published in Hypertension) as “a complex article describing perhaps the most important and highest resource project to date (Aurora Project) on assessing the accuracy of PWA and PWA devices.”

The Microsoft article was written for bioengineers. The review in Hypertension explains the project for clinicians, and concludes that, “Cuffless BP devices based on PWA and PWA-PAT, which are similar to some regulatory-cleared devices, were of no additional value in measuring auscultatory or 24-hour ambulatory cuff BP when compared with a baseline model in which BP was predicted without an actual measurement.”
 

 

 

IEEE and FDA validation

Despite these concerns, several cuffless devices using PWA and PAT have been cleared by the Food and Drug Administration.

Validating cuffless devices is no simple matter. The Institute of Electrical and Electronics Engineers published a validation protocol for cuffless blood pressure devices in 2014 that was amended in 2019 to include a requirement to evaluate performance in different positions and in the presence of motion with varying degrees of noise artifact.

However, Daichi Shimbo, MD, codirector of the Columbia Hypertension Center in New York and vice chair of the American Heart Association Statement on blood pressure monitoring, and colleagues point out limitations, even in the updated standard. These include not requiring evaluation for drift over time; lack of specific dynamic testing protocols for stressors such as exercise or environmental temperatures; and an unsuitable reference standard (oscillometric cuff-based devices) during movement.

Dr. Shimbo said in an interview that, although he is excited about them, “these cuffless devices are not aligned with regulatory bodies. If a device gives someone a wrong blood pressure, they might be diagnosed with hypertension when they don’t have it or might miss the fact that they’re hypertensive because they get a normal blood pressure reading. If there’s no yardstick by which you say these devices are good, what are we really doing – helping, or causing a problem?”

“The specifics of how a device estimates blood pressure can determine what testing is needed to ensure that it is providing accurate performance in the intended conditions of use,” Jeremy Kahn, an FDA press officer, said in an interview. “For example, for cuffless devices that are calibrated initially with a cuff-based blood pressure device, the cuffless device needs to specify the period over which it can provide accurate readings and have testing to demonstrate that it provides accurate results over that period of use.”

The FDA said its testing is different from what the Microsoft Aurora Project used in their study.

“The intent of that testing, as the agency understands it, is to evaluate whether the device is providing useful input based on the current physiology of the patient rather than relying on predetermined values based on calibration or patient attributes. We evaluate this clinically in two separate tests: an induced change in blood pressure test and tracking of natural blood pressure changes with longer term device use,” Mr. Kahn explained.

Analyzing a device’s performance on individuals who have had natural changes in blood pressure as compared to a calibration value or initial reading “can also help discern if the device is using physiological data from the patient to determine their blood pressure accurately,” he said.

Experts interviewed for this article who remain skeptical about cuffless BP monitoring question whether the numbers that appear during the induced blood pressure change, and with the natural blood pressure changes that may occur over time, accurately reflect a patient’s blood pressure.

“The FDA doesn’t approve these devices; they clear them,” Dr. Shimbo pointed out. “Clearing them means they can be sold to the general public in the U.S. It’s not a strong statement that they’re accurate.”
 

 

 

Moving toward validation, standards

Ultimately, cuffless BP monitors may require more than one validation protocol and standard, depending on their technology, how and where they will be used, and by whom.

And as Dr. Plante and colleagues write, “Importantly, validation should be performed in diverse and special populations, including pregnant women and individuals across a range of heart rates, skin tones, wrist sizes, common arrhythmias, and beta-blocker use.”

Organizations that might be expected to help move validation and standards forward have mostly remained silent. The American Medical Association’s US Blood Pressure Validated Device Listing website includes only cuffed devices, as does the website of the international scientific nonprofit STRIDE BP.

The European Society of Hypertension 2022 consensus statement on cuffless devices concluded that, until there is an internationally accepted accuracy standard and the devices have been tested in healthy people and those with suspected or diagnosed hypertension, “cuffless BP devices should not be used for the evaluation or management of hypertension in clinical practice.”

This month, ESH published recommendations for “specific, clinically meaningful, and pragmatic validation procedures for different types of intermittent cuffless devices” that will be presented at their upcoming annual meeting June 26.

Updated protocols from IEEE “are coming out soon,” according to Dr. Shimbo. The FDA says currently cleared devices won’t need to revalidate according to new standards unless the sponsor makes significant modifications in software algorithms, device hardware, or targeted patient populations.
 

Device makers take the initiative

In the face of conflicting reports on accuracy and lack of a robust standard, some device makers are publishing their own tests or encouraging validation by potential customers.

For example, institutions that are considering using the Biobeat cuffless blood pressure monitor watch “usually start with small pilots with our devices to do internal validation,” Lior Ben Shettrit, the company’s vice president of business development, said in an interview. “Only after they complete the internal validation are they willing to move forward to full implementation.”

Cardiologist Dean Nachman, MD, is leading validation studies of the Biobeat device at the Hadassah Ein Kerem Medical Center in Jerusalem. For the first validation, the team recruited 1,057 volunteers who did a single blood pressure measurement with the cuffless device and with a cuffed device.

“We found 96.3% agreement in identifying hypertension and an interclass correlation coefficient of 0.99 and 0.97 for systolic and diastolic measurements, respectively,” he said. “Then we took it to the next level and compared the device to ambulatory 24-hour blood pressure monitoring and found comparable measurements.”

The investigators are not done yet. “We need data from thousands of patients, with subgroups, to not have any concerns,” he says. “Right now, we are using the device as a general monitor – as an EKG plus heart rate plus oxygen saturation level monitor – and as a blood pressure monitor for 24-hour blood pressure monitoring.”

The developers of the Aktiia device, which is the one Dr. Topol tested, take a different perspective. “When somebody introduces a new technology that is disrupting something that has been in place for over 100 years, there will always be some grumblings, ruffling of feathers, people saying it’s not ready, it’s not ready, it’s not ready,” Aktiia’s chief medical officer Jay Shah, MD, noted.

“But a lot of those comments are coming from the isolation of an ivory tower,” he said.

Aktiia cofounder and chief technology officer Josep Solà said that “no device is probably as accurate as if you have an invasive catheter,” adding that “we engage patients to look at their blood pressure day by day. … If each individual measurement of each of those patient is slightly less accurate than a cuff, who cares? We have 40 measurements per day on each patient. The accuracy and precision of each of those is good.”

Researchers from the George Institute for Global Health recently compared the Aktiia device to conventional ambulatory monitoring in 41 patients and found that “it did not accurately track night-time BP decline and results suggested it was unable to track medication-induced BP changes.”

“In the context of 24/7 monitoring of hypertensive patients,” Mr. Solà said, “whatever you do, if it’s better than a sham device or a baseline model and you track the blood pressure changes, it’s a hundred times much better than doing nothing.”

Dr. Nachman and Dr. Plante reported no relevant financial relationships. Dr. Shimbo reported that he received funding from NIH and has consulted for Abbott Vascular, Edward Lifesciences, Medtronic, and Tryton Medical.

A version of this article first appeared on Medscape.com.

Medscape’s Editor-in-Chief Eric Topol, MD, referred to continual noninvasive, cuffless, accurate blood pressure devices as “a holy grail in sensor technology.”

He personally tested a cuff-calibrated, over-the-counter device available in Europe that claims to monitor daily blood pressure changes and produce data that can help physicians titrate medications.

Dr. Topol does not believe that it is ready for prime time. Yes, cuffless devices are easy to use, and generate lots of data. But are those data accurate?

Many experts say not yet, even as the market continues to grow and more devices are introduced and highlighted at high-profile consumer events.
 

Burned before

Limitations of cuffed devices are well known, including errors related to cuff size, patient positioning, patient habits or behaviors (for example, caffeine/nicotine use, acute meal digestion, full bladder, very recent physical activity) and clinicians’ failure to take accurate measurements.

But are the currently available cuffless devices acceptable substitutes?

Like many clinicians, Timothy B. Plante, MD, MHS, assistant professor at the University of Vermont Medical Center thrombosis & hemostasis program in Burlington, is very excited about cuffless technology. However, “we’ve been burned by it before,” he said in an interview.

Dr. Plante’s 2016 validation study of an instant blood pressure smartphone app found that its measurements were “highly inaccurate,” with such low sensitivity that more than three-quarters of individuals with hypertensive blood levels would be falsely reassured that their blood pressure was in the normal range.

His team’s 2023 review of the current landscape, which includes more sophisticated devices, concluded that accuracy remains an issue: “Unfortunately, the pace of regulation of these devices has failed to match the speed of innovation and direct availability to patient consumers. There is an urgent need to develop a consensus on standards by which cuffless BP devices can be tested for accuracy.”
 

Devices, indications differ

Cuffless devices estimate blood pressure indirectly. Most operate based on pulse wave analysis and pulse arrival time (PWA-PAT), explained Ramakrishna Mukkamala, PhD, in a commentary. Dr. Mukkamala is a professor in the departments of bioengineering and anesthesiology and perioperative medicine at the University of Pittsburgh.

PWA involves measuring a peripheral arterial waveform using an optical sensor such as the green lights on the back of a wrist-worn device, or a ‘force sensor’ such as a finger cuff or pressing on a smartphone. Certain features are extracted from the waveform using machine learning and calibrated to blood pressure values.

PAT techniques work together with PWA; they record the ECG and extract features from that signal as well as the arterial waveform for calibration to blood pressure values.

The algorithm used to generate the BP numbers comprises a proprietary baseline model that may include demographics and other patient characteristics. A cuff measurement is often part of the baseline model because most cuffless devices require periodic (typically weekly or monthly) calibration using a cuffed device.

Cuffless devices that require cuff calibration compare the estimate they get to the cuff-calibrated number. In this scenario, the cuffless device may come up with the same blood pressure numbers simply because the baseline model – which is made up of thousands of data points relevant to the patient – has not changed.

This has led some experts to question whether PWA-PAT cuffless device readings actually add anything to the baseline model.

They don’t, according to Microsoft Research in what Dr. Mukkamala and coauthors referred to (in a review published in Hypertension) as “a complex article describing perhaps the most important and highest resource project to date (Aurora Project) on assessing the accuracy of PWA and PWA devices.”

The Microsoft article was written for bioengineers. The review in Hypertension explains the project for clinicians, and concludes that, “Cuffless BP devices based on PWA and PWA-PAT, which are similar to some regulatory-cleared devices, were of no additional value in measuring auscultatory or 24-hour ambulatory cuff BP when compared with a baseline model in which BP was predicted without an actual measurement.”
 

 

 

IEEE and FDA validation

Despite these concerns, several cuffless devices using PWA and PAT have been cleared by the Food and Drug Administration.

Validating cuffless devices is no simple matter. The Institute of Electrical and Electronics Engineers published a validation protocol for cuffless blood pressure devices in 2014 that was amended in 2019 to include a requirement to evaluate performance in different positions and in the presence of motion with varying degrees of noise artifact.

However, Daichi Shimbo, MD, codirector of the Columbia Hypertension Center in New York and vice chair of the American Heart Association Statement on blood pressure monitoring, and colleagues point out limitations, even in the updated standard. These include not requiring evaluation for drift over time; lack of specific dynamic testing protocols for stressors such as exercise or environmental temperatures; and an unsuitable reference standard (oscillometric cuff-based devices) during movement.

Dr. Shimbo said in an interview that, although he is excited about them, “these cuffless devices are not aligned with regulatory bodies. If a device gives someone a wrong blood pressure, they might be diagnosed with hypertension when they don’t have it or might miss the fact that they’re hypertensive because they get a normal blood pressure reading. If there’s no yardstick by which you say these devices are good, what are we really doing – helping, or causing a problem?”

“The specifics of how a device estimates blood pressure can determine what testing is needed to ensure that it is providing accurate performance in the intended conditions of use,” Jeremy Kahn, an FDA press officer, said in an interview. “For example, for cuffless devices that are calibrated initially with a cuff-based blood pressure device, the cuffless device needs to specify the period over which it can provide accurate readings and have testing to demonstrate that it provides accurate results over that period of use.”

The FDA said its testing is different from what the Microsoft Aurora Project used in their study.

“The intent of that testing, as the agency understands it, is to evaluate whether the device is providing useful input based on the current physiology of the patient rather than relying on predetermined values based on calibration or patient attributes. We evaluate this clinically in two separate tests: an induced change in blood pressure test and tracking of natural blood pressure changes with longer term device use,” Mr. Kahn explained.

Analyzing a device’s performance on individuals who have had natural changes in blood pressure as compared to a calibration value or initial reading “can also help discern if the device is using physiological data from the patient to determine their blood pressure accurately,” he said.

Experts interviewed for this article who remain skeptical about cuffless BP monitoring question whether the numbers that appear during the induced blood pressure change, and with the natural blood pressure changes that may occur over time, accurately reflect a patient’s blood pressure.

“The FDA doesn’t approve these devices; they clear them,” Dr. Shimbo pointed out. “Clearing them means they can be sold to the general public in the U.S. It’s not a strong statement that they’re accurate.”
 

 

 

Moving toward validation, standards

Ultimately, cuffless BP monitors may require more than one validation protocol and standard, depending on their technology, how and where they will be used, and by whom.

And as Dr. Plante and colleagues write, “Importantly, validation should be performed in diverse and special populations, including pregnant women and individuals across a range of heart rates, skin tones, wrist sizes, common arrhythmias, and beta-blocker use.”

Organizations that might be expected to help move validation and standards forward have mostly remained silent. The American Medical Association’s US Blood Pressure Validated Device Listing website includes only cuffed devices, as does the website of the international scientific nonprofit STRIDE BP.

The European Society of Hypertension 2022 consensus statement on cuffless devices concluded that, until there is an internationally accepted accuracy standard and the devices have been tested in healthy people and those with suspected or diagnosed hypertension, “cuffless BP devices should not be used for the evaluation or management of hypertension in clinical practice.”

This month, ESH published recommendations for “specific, clinically meaningful, and pragmatic validation procedures for different types of intermittent cuffless devices” that will be presented at their upcoming annual meeting June 26.

Updated protocols from IEEE “are coming out soon,” according to Dr. Shimbo. The FDA says currently cleared devices won’t need to revalidate according to new standards unless the sponsor makes significant modifications in software algorithms, device hardware, or targeted patient populations.
 

Device makers take the initiative

In the face of conflicting reports on accuracy and lack of a robust standard, some device makers are publishing their own tests or encouraging validation by potential customers.

For example, institutions that are considering using the Biobeat cuffless blood pressure monitor watch “usually start with small pilots with our devices to do internal validation,” Lior Ben Shettrit, the company’s vice president of business development, said in an interview. “Only after they complete the internal validation are they willing to move forward to full implementation.”

Cardiologist Dean Nachman, MD, is leading validation studies of the Biobeat device at the Hadassah Ein Kerem Medical Center in Jerusalem. For the first validation, the team recruited 1,057 volunteers who did a single blood pressure measurement with the cuffless device and with a cuffed device.

“We found 96.3% agreement in identifying hypertension and an interclass correlation coefficient of 0.99 and 0.97 for systolic and diastolic measurements, respectively,” he said. “Then we took it to the next level and compared the device to ambulatory 24-hour blood pressure monitoring and found comparable measurements.”

The investigators are not done yet. “We need data from thousands of patients, with subgroups, to not have any concerns,” he says. “Right now, we are using the device as a general monitor – as an EKG plus heart rate plus oxygen saturation level monitor – and as a blood pressure monitor for 24-hour blood pressure monitoring.”

The developers of the Aktiia device, which is the one Dr. Topol tested, take a different perspective. “When somebody introduces a new technology that is disrupting something that has been in place for over 100 years, there will always be some grumblings, ruffling of feathers, people saying it’s not ready, it’s not ready, it’s not ready,” Aktiia’s chief medical officer Jay Shah, MD, noted.

“But a lot of those comments are coming from the isolation of an ivory tower,” he said.

Aktiia cofounder and chief technology officer Josep Solà said that “no device is probably as accurate as if you have an invasive catheter,” adding that “we engage patients to look at their blood pressure day by day. … If each individual measurement of each of those patient is slightly less accurate than a cuff, who cares? We have 40 measurements per day on each patient. The accuracy and precision of each of those is good.”

Researchers from the George Institute for Global Health recently compared the Aktiia device to conventional ambulatory monitoring in 41 patients and found that “it did not accurately track night-time BP decline and results suggested it was unable to track medication-induced BP changes.”

“In the context of 24/7 monitoring of hypertensive patients,” Mr. Solà said, “whatever you do, if it’s better than a sham device or a baseline model and you track the blood pressure changes, it’s a hundred times much better than doing nothing.”

Dr. Nachman and Dr. Plante reported no relevant financial relationships. Dr. Shimbo reported that he received funding from NIH and has consulted for Abbott Vascular, Edward Lifesciences, Medtronic, and Tryton Medical.

A version of this article first appeared on Medscape.com.

Publications
Publications
Topics
Article Type
Sections
Disallow All Ads
Content Gating
No Gating (article Unlocked/Free)
Alternative CME
Disqus Comments
Default
Use ProPublica
Hide sidebar & use full width
render the right sidebar.
Conference Recap Checkbox
Not Conference Recap
Clinical Edge
Display the Slideshow in this Article
Medscape Article
Display survey writer
Reuters content
Disable Inline Native ads
WebMD Article