
Can AI Understand the Value of my Poetry Assignment? Critical Role of Perceived AI Task Fit and Outcome Favorability in User Trust
S. Mo Jones-Jang, Nuri Kim, Myojung Chung, Jihyang Choi, Sangwon Lee
Journal Article
|
April 29, 2026
Receiving a disappointing grade from an AI evaluator often leads individuals to question the system’s competence. This external attribution is common and underscores why many remain uneasy about AI-based evaluations. Yet, what specifically fuels this distrust? This study investigates how receiving a negative evaluation affects people’s trust in AI compared to human evaluators, particularly focusing on the perceived suitability of the evaluation task for AI. In an experiment with 448 young adults, participants were significantly more likely to blame AI evaluators for unfavorable outcomes, especially when tasks were subjective (e.g., poetry assessments) rather than objective (e.g., biology lab reports). Such blame considerably undermines trust in AI systems. This research highlights the importance of aligning AI’s capabilities with appropriate evaluation tasks as a critical pathway to enhancing trust in AI-based evaluation systems.
citation
Jones-Jang, S. M., Kim, N., Chung, M., Choi, J., & Lee, S. (2026). Can AI Understand the Value of my Poetry Assignment? Critical Role of Perceived AI Task Fit and Outcome Favorability in User Trust. International Journal of Human–Computer Interaction, 1-15. https://doi.org/10.1080/10447318.2026.2663075
topics
Artificial Intelligence
Artificial Intelligence
Artificial Intelligence
Artificial Intelligence
related work

Measuring Agency-Amplifying AI Literacy: The HuskyAI Coaching Platform for Workforce Readiness
July 2026
HuskyAI is a web platform on which students develop AI knowledge by working through authentic
Artificial Intelligence
Artificial Intelligence
Working Paper


Measuring Agency-Amplifying AI Literacy: The HuskyAI Coaching Platform for Workforce Readiness
July 2026
HuskyAI is a web platform on which students develop AI knowledge by working through authentic
Artificial Intelligence
Artificial Intelligence
Working Paper


Measuring Agency-Amplifying AI Literacy: The HuskyAI Coaching Platform for Workforce Readiness
July 2026
HuskyAI is a web platform on which students develop AI knowledge by working through authentic
Artificial Intelligence
Artificial Intelligence
Working Paper

.png)