Published January 1, 2026 | Version v1

Bias Propagation Analysis In AI Chatbots Using Prompt-Based Fairness Evaluation

Description

AI chatbots and large language models show up almost everywhere these days - customer support, healthcare, schools, even hiring. While they're good at handling language, there's still a big question about bias. These systems often pick up biases from their training data and then reflect them back in their answers. That includes biases related to gender, jobs, places, or wealth. This study explores whether chatbots respond to demographic-based questions with built-in bias. We used a set of structured prompts and gathered answers from several AI chatbots, recording all responses for analysis. Every answer was examined using sentiment analysis and a neutrality scoring method. This measured how fair or unbiased each system was. We performed all our analysis using Python tools like Pandas, TextBlob, and Matplotlib. Our expectation was that chatbot responses would usually be objective, but some subtle biases could sneak in depending on how you ask the question or what the topic is. Some questions just lead to more bias than others. By scoring fairness, we can actually quantify differences and see which systems are more neutral. This approach helps assess how these AI tools deal with real-world issues and fairness.

Files

IJSET_V14_issue2_550.pdf

Files (567.2 kB)

Name Size Download all
md5:e2486d50313b00226dfc6228d5c74bca
567.2 kB Preview Download

Additional details