AI Health Outcome Prediction Project Put on Hold Due to GP Data Concerns

Key Takeaways

NHS England has halted the development of the Foresight AI model after concerns about the use of GP patient data arose.
Doctors were unaware that GP data collected for Covid-19 research had been used for training the AI model.
The project will undergo a review to ensure compliance with GDPR and data protection standards.

Concerns Over Patient Data Usage

NHS England has temporarily paused the development of the Foresight AI model, which aims to predict future health outcomes, following concerns from health professionals regarding the use of GP patient data. The project, supported by researchers from University College London and King’s College London, utilized de-identified data from 57 million individuals across England as part of a pilot initiative to explore the potential of AI in enhancing personalized healthcare and early intervention.

The British Medical Association (BMA) and the Royal College of General Practitioners, through their joint GP IT committee, expressed their surprise that GP data, gathered specifically for Covid-19 research, was used to train the Foresight model. Dr. David Wrigley, deputy chair of the BMA England GP committee, highlighted the critical need to maintain patient trust regarding the confidentiality of their data.

Wrigley stated, “We were not aware that GP data, collected for Covid-19 research, was being used to train an AI model, Foresight. As such, we are unclear if the correct processes were followed to ensure that data was shared in line with patients’ expectations and established governance processes.” He emphasized that patients should not have to worry about their confidential information being used without appropriate safeguards in place.

In response to these concerns, NHS England acknowledged the importance of patient privacy within the project and expressed gratitude to the joint GP IT committee for voicing their issues. An NHSE spokesperson confirmed that GDPR principles are pivotal to the project and indicated that the initiative would be paused while their data protection officer conducts a thorough review. This review will determine if further actions are necessary to ensure compliance with data protection norms.

Furthermore, NHSE clarified that the research was conducted under a data-sharing agreement with a consortium led by the British Heart Foundation Data Science Centre. This agreement was previously reviewed by the GP Profession Advisory Group. The research is said to have taken place within NHSE’s Secure Data Environment (SDE), a controlled setting that restricts external access. Any data leaving the SDE must first be vetted by NHS personnel to ensure that results cannot be traced back to individual patients.

The decision to pause the Foresight model underlines the significant concerns surrounding patient data privacy and the ethical use of AI in healthcare. Both the BMA and GP IT committee continue to advocate for transparency and the establishment of stringent governance processes to protect sensitive patient information, ensuring that patients’ rights and expectations are prioritized as AI technologies are developed in the healthcare sector.

The content above is a summary. For more details, see the source article.