Attractiveness bias in Artificial Intelligence systems
DOI:
https://doi.org/10.23755/rm.v56i0.1745Keywords:
decision analysis, LLM, cognitive bias, attractiveness biasAbstract
Cognitive biases are thought patterns that can lead to incorrect decisions and judgments. Recently, Large Language Models (LLMs) have been shown to be capable of processing and understanding language well. However, because they learn from human data, they may also pick up human biases. While several scholars have analyzed social biases in LLMs, cognitive biases have not been studied as thoroughly. The goal of this research is to analyze how Artificial Intelligence (AI) may be susceptible to a particular cognitive bias, namely attractiveness bias, highlighting the consequences of using LLMs. This is a bias according to which people considered more attractive are viewed more positively than those considered less attractive. The use of AI in sensitive fields, such as the legal sector, where neutrality is essential, requires regulations that limit the risk of bias. However, the results show that AI technologies are susceptible to cognitive biases, highlighting a lack of clarity and robustness at key decision-making moments.References
Ackerman, S., Farchi, E., Raz, O., & Toledo, A. (2025). Statistical multi-metric evaluation and visualization of LLM system predictive performance. arXiv preprint arXiv:2501.18243.
Ameli, S., Zhuang, S., Stoica, I., & Mahoney, M. W. (2024). A statistical framework for ranking llm-based chatbots. arXiv preprint arXiv:2412.18407.
Agarwal, D., Fabbri, A. R., Risher, B., Laban, P., Joty, S., & Wu, C. S. (2024, November). Prompt leakage effect and mitigation strategies for multi-turn LLM applications. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing: Industry Track (pp. 1255-1275).
Batres, C., & Shiramizu, V. (2023). Examining the “attractiveness halo effect” across cultures. Current Psychology, 42(29), 25515-25519.
Campbell, H., Goldman, S., & Markey, P. M. (2025). Artificial intelligence and human decision making: Exploring similarities in cognitive bias. Computers in Human Behavior: Artificial Humans, 4, 100138.
Cheung, V., Maier, M., & Lieder, F. (2025). Large language models show amplified cognitive biases in moral decision-making. Proceedings of the National Academy of Sciences, 122(25), e2412015122.
Cordeiro, G. M., Ferrari, S. L., & Cysneiros, A. H. M. (1998). A formula to improve score test statistics. Journal of Statistical Computation and Simulation, 62(1-2), 123-136.
Dash, B. P., & Obaidullah, K. A. (1970). Determination of signal and noise statistics using correlation theory. Geophysics, 35(1), 24-32.
Dion, K., Berscheid, E., & Walster, E. (1972). What is beautiful is good. Journal of personality and social psychology, 24(3), 285.
Echterhoff, J., Liu, Y., Alessa, A., McAuley, J., & He, Z. (2024). Cognitive bias in decision-making with LLMs. arXiv preprint arXiv:2403.00811.
Filandrianos, G., Dimitriou, A., Lymperaiou, M., Thomas, K., & Stamou, G. (2025). Bias Beware: The Impact of Cognitive Biases on LLM-Driven Product Recommendations. arXiv preprint arXiv:2502.01349.
Gravetter, F. J., & Wallnau, L. B. (2014). Introduction to the t statistic. Essentials of statistics for the behavioral sciences, 8(252).
Gulati, A., D'Incà, M., Sebe, N., Lepri, B., & Oliver, N. (2025). Beauty and the Bias: Exploring the Impact of Attractiveness on Multimodal Large Language Models. arXiv preprint arXiv:2504.16104.
He, J., & Liu, J. (2025). Investigating the Impact of LLM Personality on Cognitive Bias Manifestation in Automated Decision-Making Tasks. arXiv preprint arXiv:2502.14219.
Jia, J. J., Yuan, Z., Pan, J., McNamara, P., & Chen, D. (2024). Decision-making behavior evaluation framework for llms under uncertain context. Advances in Neural Information Processing Systems, 37, 113360-113382.
Kumar, C. V., Urlana, A., Kanumolu, G., Garlapati, B. M., & Mishra, P. (2025). No LLM is Free From Bias: A Comprehensive Study of Bias Evaluation in Large Language models. arXiv preprint arXiv:2503.11985.
Lyu, Y., Ren, S., Feng, Y., Wang, Z., Chen, Z., Ren, Z., & de Rijke, M. (2025). Cognitive debiasing large language models for decision-making. arXiv preprint arXiv:2504.04141.
Nazer, L. H., Zatarah, R., Waldrip, S., Ke, J. X. C., Moukheiber, M., Khanna, A. K., ... & Mathur, P. (2023). Bias in artificial intelligence algorithms and recommendations for mitigation. PLOS digital health, 2(6), e0000278.
Nienhaus, S. (2025). The Impact of Physical Attractiveness and Type of Crime in Judicial Decision Making (Master's thesis, University of Twente).
Ross, A., & Willson, V. L. (2017). Independent samples T-test. In Basic and advanced statistical tests: Writing results sections and creating tables and figures (pp. 13-16). Rotterdam: SensePublishers.
Stureborg, R., Alikaniotis, D., & Suhara, Y. (2024). Large language models are inconsistent and biased evaluators. arXiv preprint arXiv:2405.01724.
Williams, L. J., & Abdi, H. (2010). Fisher’s least significant difference (LSD) test. Encyclopedia of research design, 218(4), 840-853.
Downloads
Published
Issue
Section
License
This journal provides immediate open access to its content on the principle that making research freely available to the public supports a greater global exchange of knowledge. The journal is committed to real and immediate open access for academic work. All of the journal articles are free to access immediately from the date of publication. There are no charge for readers to download articles and reviews for their own scholarly use. Benefits of open access for authors, include:
- Free access for all users worldwide
- Increased visibility and readership
- Rapid publication
- No spatial constraints
- Authors can share their research papers on their personal web-pages (i.e. ResearchGate, etc.)
Ratio Mathematica publishes open access articles under the terms of the Creative Commons Attribution (CC BY) License. The Creative Commons Attribution License (CC-BY) allows users to copy, distribute and transmit an article, adapt the article and make commercial use of the article. The CC BY license permits commercial and non-commercial re-use of an open access article, as long as the author is properly attributed. Copyright on any research article published by Ratio Mathematica is retained by the author(s). Authors grant Ratio Mathematica a license to publish the article and identify itself as the original publisher. Authors also grant any third party the right to use the article freely as long as its original authors, citation details and publisher are identified.
For further information visit: https://creativecommons.org/licenses/by/3.0/. The following logo will appear in any paper that will be published from the volume number 31/2016 onwards.