News | Magnetic Resonance Imaging (MRI) | November 15, 2019

The study finds it's possible to use commercial facial recognition software to identify people from brain MRI that includes imagery of the face

The study finds it's possible to use commercial facial recognition software to identify people from brain MRI that includes imagery of the face

November 15, 2019 — Though identifying data typically are removed from medical image files before they are shared for research, a Mayo Clinic study finds that this may not be enough to protect patient privacy.

"At Mayo Clinic, we take patient privacy as a core value," said Christopher Schwarz, Ph.D., a Mayo Clinic researcher and computer scientist in the Center for Advanced Imaging Research, and the study's lead author. "We are studying potential gaps in deidentification as we seek ways to improve these techniques."

The study, described in a letter published in The New England Journal of Medicine, finds that it's possible to use commercial facial recognition software to identify people from brain magnetic resonance imaging (MRI) that includes imagery of the face, despite steps that researchers typically take to protect patient privacy. This is a potential issue for study participants who share brain imaging data. It is not related to patient care, and it is not limited or specific to studies at Mayo Clinic.

"This is only applicable if people can get access to the MRI scans in publicly available research databases. It is not related to medical care, where data is secured," Schwarz said.

The researchers add that this risk is only applicable to people whose imaging data has been released into the public domain through their participation in research studies, and typically before researchers can gain access to the data they are required to sign a data-use agreement in which they state they will not try to identify the participants.

Today's standard when sharing MRI scans for research is to remove identifiers such as name and identification number. But imagery of the face included in MRI remains accessible. Software programs to remove or blur faces in MRIs have been available for many years, but they haven't been widely used because they can degrade researchers' ability to automatically measure brain structures from the images, according to Schwarz. Even when used, the software may not fully prevent reidentification of the patient.

To determine whether facial recognition software could identify people from an MRI, researchers recruited 84 volunteers who had an existing brain MRI from within the past three months and then took additional photographs. Researchers then created facial reconstruction images from each MRI and attempted to match these images to the photographs using publicly available facial recognition software.

For 70 of 84 participants, the correct MRI image was chosen as the software's No. 1 match for those participants' photographs, an 83 percent success rate. In 80 of 84 cases, the correct MRI image was among the top five possible matches for participants' photos, a 95 percent success rate.

"Our study's 83 percent match rate suggests that facial recognition presents a possible means to reidentify research participants from their cranial MRIs," according to the researchers. This could mean a breach of associated health information, including diagnoses, genetic data and results of other imaging.

Institutions typically only share imaging data with researchers who legally commit not to attempt to identify participants. Still, "We understand there are concerns about the negative impact of facial recognition technology on personal privacy," said Clifford Jack, M.D., a Mayo Clinic radiologist and senior author, who also is a member of National Academy of Medicine. Jack is the Alexander Family Professor of Alzheimer's Disease Research.

"Dr. Schwarz's work points out that these concerns include the possibility of identifying individual research participants who have been guaranteed anonymity as a condition of their participation in medical research. This is an issue that the medical research community must be aware of and address."

The Mayo team plans to publish another manuscript detailing their novel potential solution and how it improves on existing privacy protection efforts.

"We are making good progress toward an initial solution," said Schwarz. "Making data private and keeping it private is an always-evolving field. The insights we gained in this study will help us in our work to keep patient data private and use it more effectively for research into diseases and potential new therapies."

"With advances in digital technologies, in this case facial recognition software, it's critical that we continue to revisit the promises that we've made to our patients, particularly promises related to the confidentiality of their medical data," said Richard Sharp, Ph.D., Lloyd A. and Barbara A. Amundson Professor of Biomedical Ethics and director of the Biomedical Ethics Research Program, who was involved in this research. "Much of our work in biomedical ethics focuses on protecting patients from unanticipated harms and this is an excellent illustration of the importance of that work."

For more information: mayoclinic.org


Related Content

News | Bone Densitometry Systems

June 19, 2025 — Naitive Technologies has published results demonstrating the diagnostic performance of its AI-powered ...

Time June 18, 2025
arrow
News | Lung Imaging

June 18, 2025 — Exo recently announced that now included on its Exo Iris is the first ever FDA 510(k) cleared AI for ...

Time June 18, 2025
arrow
News | Imaging Software Development

June 12, 2025 — GE HealthCare has announced the combination of GE HealthCare’s proprietary features and algorithms with ...

Time June 12, 2025
arrow
News | Digital Pathology

June 11, 2025 — Diagnostic laboratory leaders view digital pathology and artificial intelligence (AI) as pivotal to ...

Time June 12, 2025
arrow
News | Lung Imaging

June 11, 2025 — To prepare healthcare workforces and providers for an AI-driven future, Qure.ai has expanded its Global ...

Time June 11, 2025
arrow
News | Radiology Imaging

June 10, 2025 — CIVIE has announced the official launch of RadPod, an AI-driven, on-demand radiology platform designed ...

Time June 10, 2025
arrow
News | Ultrasound Imaging

June 4, 2025 — RadNet, Inc., a provider of high-quality, cost-effective diagnostic imaging services and digital health ...

Time June 09, 2025
arrow
News | Mammography

June 9, 2025 — A new independent, peer-reviewed study published in the journal Clinical Breast Cancer reinforces the ...

Time June 09, 2025
arrow
News | Imaging Software Development

June 05, 2025 — Nano-X Imaging Ltd. has announced that its deep-learning medical imaging analytics subsidiary, Nanox AI ...

Time June 05, 2025
arrow
News | Prostate Cancer

June 5, 2025 – Artera, the developer of multimodal artificial intelligence (MMAI)-based prognostic and predictive cancer ...

Time June 05, 2025
arrow
Subscribe Now