top of page
Wireframe - 8.png

Marvin Meyer / Unsplash

Measuring Agency-Amplifying AI Literacy: The HuskyAI Coaching Platform for Workforce Readiness

John P. Wihbey, Yash Phalle, Shashank Kadiyala, Caleb Okereke

Working Paper

|

July 1, 2026

access

featured in

HuskyAI is a web platform on which students develop AI knowledge by working through authentic challenges in supervised conversations with a generative model, with every message scored in real time on the Prompt Effectiveness Index (PEI).1 Using a multi-agent architecture, PEI grades the quality of a student's thinking while prompting — across Prompt Structural Quality, Conversation Control, Technical Sophistication, Cognitive Load Management, and Reliance Appropriateness — rather than whether the model produced a correct answer or polished artifact/deliverable. This paper situates the platform within multiple conversations (human agency, the cognitive risks of AI use, AI as an epistemic technology, AI fluency, the science of learning, and evaluative judgement) and shows how the system's architecture is built to meet the theoretical requirements those literatures impose. We argue that PEI provides a metric for detecting whether fluency is exercised in the augmentative mode in which the human remains the author of the collaboration rather than its audience — the conduct recent large-scale evidence (Potts and Sudhof, 2026) identifies as the difference between AI as "a lottery [and] a tool." PEI is a measure, we argue, of human cognitive integrity in an AI context. We describe the agentic evaluator behind PEI, the design choices through which it answers the literature's transparency, calibration, and validity demands, and the limitations of an in-conversation instrument as a learning tool.

citation

Wihbey, J. P., Phalle, Y., Kadiyala, S., & Okereke, C. (2026, July 1). Measuring agency-amplifying AI literacy: The HuskyAI coaching platform for workforce readiness. An applied framework for assessing the quality of learner reasoning in human-AI conversation (AIMES Lab Working Paper, DRAFT). Institute for Information, the Internet, and Democracy, Northeastern University. https://drive.google.com/file/d/1jTlgbdWbClsU0_zkyxnhQmjthwnK3FF3/view

topics

Artificial Intelligence

Artificial Intelligence

related work

Rectangle 35
Broken, Buried, or Missing: Anatomies of Failure (and Success) of Social Media Child Safety Features

June 29, 2026

Lexie Matsumoto, Arturo Béjar, Abdulraheem Arar, Damon McCoy, Laura Edelson

Social Media
Expert Opinion
Rectangle 35
Measuring Agency-Amplifying AI Literacy: The HuskyAI Coaching Platform for Workforce Readiness

July 1, 2026

John P. Wihbey, Yash Phalle, Shashank Kadiyala, Caleb Okereke

Artificial Intelligence

Working Paper

Rectangle 35
How Americans Spend their Time Online

June 8, 2026

David Lazer, Burak Ozturan, Christo Wilson, David Choffnes, Cassidy Waldrip, Hsiu-Chi Lu, John Wihbey

Social Media
Online Behavior
Expert Opinion
bottom of page