Friday 21 September 2018

We are delighted to announce that LCFI postdoctoral researcher Dr Rune Nyrup has been awarded a seed award in Humanities and Social Science by the Wellcome Trust. The £86,500 grant will be used to fund the research project 'Understanding Medical Black Boxes: A philosophical analysis of AI explainability'.

While modern AI systems can display impressive accuracy in medical tasks, it can be difficult to fully explain how they work or why they make individual decisions. The development of techniques for making systems “intelligible” or “explainable” is a growing focus of research within machine learning. However, there is still no consensus on what “understanding” or “explanation” amounts to in this context.

Moreover, many of the processes and decisions already involved in medicine are not fully explainable. Randomised controlled trials can provide evidence for the efficaciousness of a drug even if researchers do not fully understand the underlying physiological mechanism. Physicians can trust the expert judgment of their radiologist colleague, even if the radiologist cannot fully explain how they are able to recognise tumours as malignant. Patients do not need a detailed understanding of a proposed treatment, or of their physicians’ decision-making processes, to trust and consent to it.

Given the ubiquity of medical “black boxes”, it is unclear whether a lack of AI explainability poses any novel problems in the medical domain. This project will use theoretical tools from philosophy of science, philosophy of medicine and medical ethics to enhance our understanding of the nature and importance AI explainability in medical contexts.

The eighteen month project will begin in Spring 2019.