New research reveals how humans judge the moral minds of artificial intelligence
New research reveals how humans judge the moral minds of artificial intelligence
Publish Date: 2026-05-30 14:12:00
Source Domain: www.psypost.org
- Artificial intelligence systems are increasingly being tasked to make recommendations with serious moral consequences, leading to questions about how humans decide to trust these AI advisors.
- Researchers explored how humans perceive the moral minds of artificial conversational agents, particularly how their communication style and the ethical choices they make impact trust.
- The study found that trust in AI does not solely depend on whether the AI acts friendly or logical; instead, it hinges on whether the AI’s communication style matches the severity of the moral situation and the ethical decisions it makes.
- Two key psychological concepts were examined: perceived moral agency (intentional, deliberate choices) and perceived moral emotion (ability to feel or express concern and care).
- During the experiment involving 447 participants, the chatbot’s trustworthiness varied based on its conversational style (warm vs. competent) and its moral stance (utilitarian vs. deontological) in the context of moral dilemmas assigned.
- Participants attributed higher emotional capacity to the AI when its personality matched its moral choices and when the situation’s severity demanded a more competent tone.
- Findings suggest that trust in AI is context-dependent, favoring warmth for low-severity scenarios and competence for high-severity situations.
- Limitations include reliance on perceptions rather than inherent moral agency in AI, brief interaction duration, and a sample focused on young, urban, highly educated Chinese participants.
- The researchers emphasize that developing AI involves prioritizing contextual appropriateness rather than mere empathy or friendliness.
- Future research aims to explore trust in longer-term, more realistic interactions, diverse demographics, and in a broader range of morally sensitive contexts.
