A riddle, wrapped in a mystery, inside an enigma: How semantic black boxes and opaque artificial intelligence confuse medical decision-making
The use of artificial intelligence (AI) in healthcare comes with opportunities but also numerous challenges. A specific challenge that remains underexplored is the lack of clear and distinct definitions of the concepts used in and/or produced by these algorithms, and how their real world meaning is...
Authors: | ; ; |
---|---|
Format: | Electronic Article |
Language: | English |
Check availability: | HBZ Gateway |
Journals Online & Print: | |
Fernleihe: | Fernleihe für die Fachinformationsdienste |
Published: |
Wiley-Blackwell
2022
|
In: |
Bioethics
Year: 2022, Volume: 36, Issue: 2, Pages: 113-120 |
RelBib Classification: | NCH Medical ethics NCJ Ethics of science ZG Media studies; Digital media; Communication studies |
Further subjects: | B
Algorithms
B medical semantics B medical AI B Decision Support B e-alerts B Clinical care |
Online Access: |
Volltext (kostenfrei) Volltext (kostenfrei) |
MARC
LEADER | 00000caa a22000002 4500 | ||
---|---|---|---|
001 | 1786294478 | ||
003 | DE-627 | ||
005 | 20220119160249.0 | ||
007 | cr uuu---uuuuu | ||
008 | 220118s2022 xx |||||o 00| ||eng c | ||
024 | 7 | |a 10.1111/bioe.12924 |2 doi | |
035 | |a (DE-627)1786294478 | ||
035 | |a (DE-599)KXP1786294478 | ||
040 | |a DE-627 |b ger |c DE-627 |e rda | ||
041 | |a eng | ||
084 | |a 1 |2 ssgn | ||
100 | 1 | |a Pierce, Robin |e VerfasserIn |4 aut | |
245 | 1 | 2 | |a A riddle, wrapped in a mystery, inside an enigma: How semantic black boxes and opaque artificial intelligence confuse medical decision-making |
264 | 1 | |c 2022 | |
336 | |a Text |b txt |2 rdacontent | ||
337 | |a Computermedien |b c |2 rdamedia | ||
338 | |a Online-Ressource |b cr |2 rdacarrier | ||
520 | |a The use of artificial intelligence (AI) in healthcare comes with opportunities but also numerous challenges. A specific challenge that remains underexplored is the lack of clear and distinct definitions of the concepts used in and/or produced by these algorithms, and how their real world meaning is translated into machine language and vice versa, how their output is understood by the end user. This “semantic” black box adds to the “mathematical” black box present in many AI systems in which the underlying “reasoning” process is often opaque. In this way, whereas it is often claimed that the use of AI in medical applications will deliver “objective” information, the true relevance or meaning to the end-user is frequently obscured. This is highly problematic as AI devices are used not only for diagnostic and decision support by healthcare professionals, but also can be used to deliver information to patients, for example to create visual aids for use in shared decision-making. This paper provides an examination of the range and extent of this problem and its implications, on the basis of cases from the field of intensive care nephrology. We explore how the problematic terminology used in human communication about the detection, diagnosis, treatment, and prognosis of concepts of intensive care nephrology becomes a much more complicated affair when deployed in the form of algorithmic automation, with implications extending throughout clinical care, affecting norms and practices long considered fundamental to good clinical care. | ||
650 | 4 | |a medical semantics | |
650 | 4 | |a medical AI | |
650 | 4 | |a e-alerts | |
650 | 4 | |a Decision Support | |
650 | 4 | |a Clinical care | |
650 | 4 | |a Algorithms | |
652 | |a NCH:NCJ:ZG | ||
700 | 1 | |a Sterckx, Sigrid |e VerfasserIn |4 aut | |
700 | 1 | |a Van Biesen, Wim |e VerfasserIn |4 aut | |
773 | 0 | 8 | |i Enthalten in |t Bioethics |d Oxford [u.a.] : Wiley-Blackwell, 1987 |g 36(2022), 2, Seite 113-120 |h Online-Ressource |w (DE-627)271596708 |w (DE-600)1480658-7 |w (DE-576)078707986 |x 1467-8519 |7 nnns |
773 | 1 | 8 | |g volume:36 |g year:2022 |g number:2 |g pages:113-120 |
856 | 4 | 0 | |u https://doi.org/10.1111/bioe.12924 |x Resolving-System |z kostenfrei |3 Volltext |
856 | 4 | 0 | |u https://onlinelibrary.wiley.com/doi/abs/10.1111/bioe.12924 |x Verlag |z kostenfrei |3 Volltext |
935 | |a mteo | ||
951 | |a AR | ||
ELC | |a 1 | ||
ITA | |a 1 |t 1 | ||
LOK | |0 000 xxxxxcx a22 zn 4500 | ||
LOK | |0 001 4037509202 | ||
LOK | |0 003 DE-627 | ||
LOK | |0 004 1786294478 | ||
LOK | |0 005 20220127121307 | ||
LOK | |0 008 220118||||||||||||||||ger||||||| | ||
LOK | |0 035 |a (DE-Tue135)IxTheo#2022-01-17#A21D9CC01A3ED2AC6452DD154EA1AF5A77967BFF | ||
LOK | |0 040 |a DE-Tue135 |c DE-627 |d DE-Tue135 | ||
LOK | |0 092 |o n | ||
LOK | |0 852 |a DE-Tue135 | ||
LOK | |0 852 1 |9 00 | ||
LOK | |0 935 |a ixzs |a zota | ||
LOK | |0 936ln |0 1764172264 |a ZG | ||
LOK | |0 936ln |0 1550736558 |a NCH | ||
LOK | |0 936ln |0 1550736582 |a NCJ | ||
OAS | |a 1 | ||
ORI | |a SA-MARC-ixtheoa001.raw | ||
REL | |a 1 | ||
SUB | |a REL |