---
title: "Digital Health Dilemma: Artificial Intelligence Device Approvals - Advancing Innovation in Dermatology"
description: A recent study highlights how medical AI devices are evaluated and issues related to AI device approval.
---

[Advancing Innovation in Dermatology - Blog](https://blog.advancing-derm.org)

# [Digital Health Dilemma: Artificial Intelligence Device Approvals - Advancing Innovation in Dermatology](https://blog.advancing-derm.org/latest-news/digital-health-dilemma-artificial-intelligence-device-approvals)

 Written by [Alexander Fogel MD, MBA](https://blog.advancing-derm.org/author/alexander-fogel) | Jul 19, 2021 12:28:24 PM

#### Artificial Intelligence is believed by many to have the potential to revolutionize medicine, but a recent study highlights issues related to AI device approval.

**How medical AI devices are evaluated: limitations and recommendations from an analysis of FDA approvals.**

In any nascent field, the development of best practices is critical to ensure the reliability, reproducibility and safety of new devices. A recent analysis by Stanford researchers reviewed the evaluation process for all 130 FDA-approved medical AI devices. The authors found that 126 of 130 such devices underwent only retrospective studies, and that none of the 54 “high-risk” devices were tested in prospective studies. Furthermore, most of the computer-aided diagnostic devices did not include a side-by-side comparison of doctor performance with and without AI, which as the authors note is a critical factor in the devices’ intended use. Most (93/1130) devices did not undergo multi-site assessment, and 59/130 devices did not include a sample size of the studies used. The authors go on to demonstrate in a case study of a pneumothorax detection software that there is substantial variability in device performance when tested across multiple clinical sites. The authors call for more prospective studies of AI-enabled devices that are measured against standard-of-care, as well as increased post-market surveillance in this new field.

*Wu E, et al. How medical AI devices are evaluated: limitations and recommendations from an analysis of FDA approvals. Nat Med. 2021 Apr;27(4):582-584.*

Figure from Wu et al. 2021. 130 FDA-approved AI medical devices characterized by body site, risk level, and study characteristics

[View full post](https://blog.advancing-derm.org/latest-news/digital-health-dilemma-artificial-intelligence-device-approvals)

```json
{
  "@context" : "http://schema.org",
  "@type" : "BlogPosting",
  "author" : {
    "@type" : "Person",
    "name" : "Alexander Fogel MD, MBA"
  },
  "dateModified" : "2022-11-10T21:39:35.302Z",
  "datePublished" : "2021-07-19T12:28:24Z",
  "headline" : "Digital Health Dilemma: Artificial Intelligence Device Approvals",
  "image" : {
    "@type" : "ImageObject",
    "height" : 834,
    "url" : "https://20649536.fs1.hubspotusercontent-na1.net/hubfs/20649536/Imported_Blog_Media/AID_Media_Artificial_Intelligence_800x400.png",
    "width" : 1667
  },
  "mainEntityOfPage" : "https://blog.advancing-derm.org/latest-news/digital-health-dilemma-artificial-intelligence-device-approvals",
  "publisher" : {
    "@type" : "Organization",
    "logo" : {
      "@type" : "ImageObject",
      "height" : 60,
      "url" : "/hs/hsstatic/content_shared_assets/static-1.4092/img/default-amp-logo.png",
      "width" : 60
    },
    "name" : "Advancing Innovation in Dermatology - Blog"
  }
}
```