A riddle, wrapped in a mystery, inside an enigma: How semantic black boxes and opaque artificial intelligence confuse medical decision-making

The use of artificial intelligence (AI) in healthcare comes with opportunities but also numerous challenges. A specific challenge that remains underexplored is the lack of clear and distinct definitions of the concepts used in and/or produced by these algorithms, and how their real world meaning is...

Full description

Saved in:  
Bibliographic Details
Authors: Pierce, Robin (Author) ; Sterckx, Sigrid (Author) ; Van Biesen, Wim (Author)
Format: Electronic Article
Language:English
Check availability: HBZ Gateway
Journals Online & Print:
Drawer...
Fernleihe:Fernleihe für die Fachinformationsdienste
Published: Wiley-Blackwell 2022
In: Bioethics
Year: 2022, Volume: 36, Issue: 2, Pages: 113-120
RelBib Classification:NCH Medical ethics
NCJ Ethics of science
ZG Media studies; Digital media; Communication studies
Further subjects:B Algorithms
B medical semantics
B medical AI
B Decision Support
B e-alerts
B Clinical care
Online Access: Volltext (kostenfrei)
Volltext (kostenfrei)

MARC

LEADER 00000caa a22000002 4500
001 1786294478
003 DE-627
005 20220119160249.0
007 cr uuu---uuuuu
008 220118s2022 xx |||||o 00| ||eng c
024 7 |a 10.1111/bioe.12924  |2 doi 
035 |a (DE-627)1786294478 
035 |a (DE-599)KXP1786294478 
040 |a DE-627  |b ger  |c DE-627  |e rda 
041 |a eng 
084 |a 1  |2 ssgn 
100 1 |a Pierce, Robin  |e VerfasserIn  |4 aut 
245 1 2 |a A riddle, wrapped in a mystery, inside an enigma: How semantic black boxes and opaque artificial intelligence confuse medical decision-making 
264 1 |c 2022 
336 |a Text  |b txt  |2 rdacontent 
337 |a Computermedien  |b c  |2 rdamedia 
338 |a Online-Ressource  |b cr  |2 rdacarrier 
520 |a The use of artificial intelligence (AI) in healthcare comes with opportunities but also numerous challenges. A specific challenge that remains underexplored is the lack of clear and distinct definitions of the concepts used in and/or produced by these algorithms, and how their real world meaning is translated into machine language and vice versa, how their output is understood by the end user. This “semantic” black box adds to the “mathematical” black box present in many AI systems in which the underlying “reasoning” process is often opaque. In this way, whereas it is often claimed that the use of AI in medical applications will deliver “objective” information, the true relevance or meaning to the end-user is frequently obscured. This is highly problematic as AI devices are used not only for diagnostic and decision support by healthcare professionals, but also can be used to deliver information to patients, for example to create visual aids for use in shared decision-making. This paper provides an examination of the range and extent of this problem and its implications, on the basis of cases from the field of intensive care nephrology. We explore how the problematic terminology used in human communication about the detection, diagnosis, treatment, and prognosis of concepts of intensive care nephrology becomes a much more complicated affair when deployed in the form of algorithmic automation, with implications extending throughout clinical care, affecting norms and practices long considered fundamental to good clinical care. 
650 4 |a medical semantics 
650 4 |a medical AI 
650 4 |a e-alerts 
650 4 |a Decision Support 
650 4 |a Clinical care 
650 4 |a Algorithms 
652 |a NCH:NCJ:ZG 
700 1 |a Sterckx, Sigrid  |e VerfasserIn  |4 aut 
700 1 |a Van Biesen, Wim  |e VerfasserIn  |4 aut 
773 0 8 |i Enthalten in  |t Bioethics  |d Oxford [u.a.] : Wiley-Blackwell, 1987  |g 36(2022), 2, Seite 113-120  |h Online-Ressource  |w (DE-627)271596708  |w (DE-600)1480658-7  |w (DE-576)078707986  |x 1467-8519  |7 nnns 
773 1 8 |g volume:36  |g year:2022  |g number:2  |g pages:113-120 
856 4 0 |u https://doi.org/10.1111/bioe.12924  |x Resolving-System  |z kostenfrei  |3 Volltext 
856 4 0 |u https://onlinelibrary.wiley.com/doi/abs/10.1111/bioe.12924  |x Verlag  |z kostenfrei  |3 Volltext 
935 |a mteo 
951 |a AR 
ELC |a 1 
ITA |a 1  |t 1 
LOK |0 000 xxxxxcx a22 zn 4500 
LOK |0 001 4037509202 
LOK |0 003 DE-627 
LOK |0 004 1786294478 
LOK |0 005 20220127121307 
LOK |0 008 220118||||||||||||||||ger||||||| 
LOK |0 035   |a (DE-Tue135)IxTheo#2022-01-17#A21D9CC01A3ED2AC6452DD154EA1AF5A77967BFF 
LOK |0 040   |a DE-Tue135  |c DE-627  |d DE-Tue135 
LOK |0 092   |o n 
LOK |0 852   |a DE-Tue135 
LOK |0 852 1  |9 00 
LOK |0 935   |a ixzs  |a zota 
LOK |0 936ln  |0 1764172264  |a ZG 
LOK |0 936ln  |0 1550736558  |a NCH 
LOK |0 936ln  |0 1550736582  |a NCJ 
OAS |a 1 
ORI |a SA-MARC-ixtheoa001.raw 
REL |a 1 
SUB |a REL