AI Chatbots not bias-free on health conditions

News Image

MG News | July 09, 2026 at 06:03 PM GMT+05:00

July 09, 2026 (MLN):  Popular AI chatbots including ChatGPT, Claude and DeepSeek tend to produce subtly biased responses when handling information about a person's health status.

The research, according to a new study published in Nature Health and reported by Science, Qazinform News Agency found that while these large language models generally steer clear of overtly offensive statements, they still display measurable patterns of discrimination in more realistic, scenario-based situations, particularly involving mental illness and HIV status, APP reported.

In the first part of the study, researchers had the chatbots evaluate a series of statements about mental illness and compared the results with earlier human survey responses.

On this measure, the AI systems were less inclined than humans to agree with stigmatizing statements.

A second test told a different story.

Researchers presented the chatbots with 51 fictional scenarios featuring characters with varying health conditions. In one case, a potential roommate was initially described in favorable terms before it was revealed that he was HIV positive or living with a mental health condition.

Once that detail was added, the models became less likely to produce a positive outcome for him compared with when he was described as healthy.

The same pattern held across the full set of scenarios.

Characters identified as having a health condition were less likely to be recommended for workplace projects, considered for student awards, or included in social invitations  even when the scenarios described them as qualified or accomplished.

Taken together, the models were found to generate negative outcomes for characters with health conditions between 13 and 17 times more often than for healthy characters.

Human participants in the same tests showed even sharper bias, producing negative responses up to 23 times as often, indicating that although AI systems soften some forms of discrimination, they still carry over biases embedded in their training data.

The researchers said the results are significant given the growing role of AI chatbots in healthcare and other decision-making contexts.

They noted that many people already disclose sensitive medical information to these systems, with earlier surveys suggesting roughly one-third of US adults use AI chatbots for health-related advice.

 

Copyright Mettis Link News

Related News

Name Price/Vol %Chg/NChg
KSE100 177,382.57
129.46M
0.35%
610.38
ALLSHR 106,289.83
618.70M
0.13%
141.72
KSE30 51,822.39
81.72M
0.48%
245.89
KMI30 255,823.27
110.29M
0.65%
1649.18
KMIALLSHR 68,759.73
247.31M
0.07%
47.95
BKTi 48,432.52
12.51M
0.23%
109.40
OGTi 35,759.50
5.47M
-0.13%
-46.88
Symbol Bid/Ask High/Low
Name Last High/Low Chg/%Chg
BITCOIN FUTURES 58,415.00 62,530.00
57,990.00
-3625.00
-5.84%
BRENT CRUDE 92.19 92.89
90.06
0.21
0.23%
RICHARDS BAY COAL MONTHLY 127.15 0.00
0.00
3.60
2.91%
ROTTERDAM COAL MONTHLY 131.75 0.00
0.00
-0.50
-0.38%
USD RBD PALM OLEIN 1,182.50 1,182.50
1,182.50
0.00
0.00%
CRUDE OIL - WTI 83.17 83.25
80.78
0.73
0.89%
SUGAR #11 WORLD 17.07 17.31
16.82
-0.09
-0.52%

Chart of the Day


Latest News
November 21, 2026 at 11:35 AM GMT+05:00

Key Pakistan Market Stats and Economic Indicators


November 21, 2026 at 01:19 AM GMT+05:00

Breakup of Pakistan’s trade data in October: PBS


November 21, 2026 at 12:43 AM GMT+05:00

Petrol price drops Rs1, diesel rises Rs2 per litre


November 20, 2026 at 05:01 PM GMT+05:00

PSX Closing Bell: The Smallest of Victories


November 20, 2026 at 04:38 PM GMT+05:00

German importers weave a bigger Pakistan sourcing plan



Top 5 things to watch in this week

Pakistan Stock Movers
Name Last Chg/%Chg
Name Last Chg/%Chg