NHS Halts AI Project Over Unauthorized Use of Health Data for 57 Million People

NHS England has halted a pioneering project. AI The project aimed at forecasting an individual’s likelihood of developing health issues was initiated following worries that data from 57 million individuals had been utilized without proper authorization.

Foresight, which uses Meta OpenAI’s source-available AI model, Llama 2, was under testing by researchers at University College. London And King's College London as part of a nationwide trial initiative examining the potential of AI in customizing healthcare strategies according to individuals' medical backgrounds.

However, the brakes were put on the innovative program when specialists cautioned that even anonymized records might include sufficient details to recognize individuals, as reported by The Observer.

A combined IT panel from the British Medical Association (BMA) and the Royal College of General Practitioners (RCGP) stated that they were unaware that data gathered for COVID-19 research was now being utilized to train an artificial intelligence model.

The organizations have likewise criticized the research coalition, spearheaded by Health Data Research UK, for not consulting a panel of physicians prior to incorporating the healthcare information of over ten million patients into Foresight.

Both BMA and RGCP have requested NHS England to report itself to the Information Commissioner regarding this issue.

Professor Kamila Hawthorne, who heads the RGCP, stated that the main concern revolves around cultivating patient trust, ensuring them that their information will not be utilized beyond the permissions they have granted.

She stated: "GPs regard the handling of their patients’ medical information with great seriousness as data custodians, and they aim to ensure that such data is not utilized outside its intended purpose, which in this instance involves training an artificial intelligence program."

We have expressed our worries to NHS England via the Joint GP IT Committee, which has requested a halt to data processing in this manner until additional inquiries are conducted, and also urged NHS England to report itself to the Information Commissioner.

'Patients must have confidence that their individual medical information is not utilized beyond the permissions they have granted, ensuring that general practitioners and the National Health Service uphold their right to data confidentiality.'

If we fail to cultivate this essential trust from patients, then all progress achieved through AI—which holds promise for enhancing medical care and easing the burden on general practitioners—will be compromised.

We look forward to receiving further updates from NHS England in the future, offering clear and open responses to guide our subsequent actions.

Katie Bramall, who chairs the BMA England GP committee, stated: "Our priority as general practitioners remains ensuring that we uphold patient confidence in the way their private information is managed."

We did not know that the GP data gathered for COVID-19 research was being utilized to train an artificial intelligence model called Foresight.

Therefore, we remain uncertain about whether appropriate procedures were adhered to guarantee that data sharing aligned with both patient expectations and predefined governance protocols.

'We have raised our concerns with NHS England through the joint GP IT committee and appreciate their verbal commitment to improve on these processes going forward.

The panel has requested NHS England to voluntarily report itself to the Information Commissioner for further clarification of all details surrounding the situation. Additionally, they have advised pausing any current operations involving data within this framework as a preventive measure until all facts are confirmed.

'Individuals should not be concerned that the information they share with their general practitioner might be used for artificial intelligence systems without comprehensive safeguards ensuring proper handling and sharing of this data.'

A representative from the NHS stated that the progress on the Foresight model has currently been put on hold.

Read more

Share :