Our initial contribution is the development of a pedagogical dashboard focused on a specific and highly realistic use of generative AI in higher education: the summarisation of academic content. The real idea of the project is not to build another AI assistant, but to create a device that makes visible the cognitive process that takes place when a student uses generative AI to summarise a text.
+
+1. What is the REAL idea of the project?
+ A device that makes visible the cognitive process when a student uses generative AI.
+
+The dashboard is activated when a student generates a summary using AI. From that moment, it brings into relation three elements: the original text, the AI output, and the student’s intervention. This comparison makes it possible to reveal, in a concrete and interpretable way, what happened during the transformation process: what was preserved, what was omitted, what was simplified, what appeared without grounding, and what was or was not reviewed by the student.
+
+2. What does the dashboard concretely do? Three things : A, B and C.
+A. Compares, brings into relation:
+ the original text, the AI output, and the student’s intervention
+ to reveal what happened in the transformation
+B. Signals, but not in a moral way, it shows:
+ · what was lost
+ · what was simplified
+ · what appears without a source
+ · what was not reviewed
+C. Shows the student their interaction and their own usage through patterns such as:
+ · automatic use vs active use
+ · editing vs copying
+ · verification vs acceptance
+Concretely, the dashboard does three things. First, it compares and relates the source text, the AI-generated summary, and the student’s modifications in order to make the transformation process visible. Second, it signals key issues without moralising them: for example, what was lost, what was oversimplified, what appears without a source, and what was accepted without revision. Third, it shows the student their own pattern of interaction with AI, making visible tendencies such as automatic use versus active use, editing versus copying, and verification versus immediate acceptance.
+
+3. What are the dashboard indicators? fron I to IV.
+I. Content fidelity — To what extent does the summary respect the original?
+ Indicators:
+ key concepts present / absent
+ distortions or simplifications
+ inventions or hallucinations
+II. Level of transformation — What did the student do with the output?
+ Indicators:
+ direct copy vs reformulation
+ text editing
+ integration of other sources
+III. Verification rigor — Did the student check anything?
+ Indicators:
+ source search
+ verification questions asked to the AI
+ comparison with original material
+IV. Reflective activation — Was there explicit thinking?
+ Indicators (non-automatic):
+ responses to prompts such as:
+ what did the AI omit
+ what did you correct
+ what do you not understand
+The dashboard is structured around four main dimensions. The first is content fidelity, which asks to what extent the summary respects the key concepts, distinctions, and nuances of the original material. Its indicators include the presence or absence of key concepts, distortions or simplifications, and possible inventions or hallucinations. The second is the level of transformation, which examines what the student actually did with the AI output: direct copy versus reformulation, degree of text editing, and integration of additional sources or ideas. The third is verification rigor, which indicates whether the student critically checked the information rather than accepting it directly. Its indicators include source searches, verification questions asked to the AI, and explicit comparison with the original material. The fourth is reflective activation, which concerns whether there was explicit thinking during the process. This dimension should not be inferred automatically, but supported through short prompts such as: What did the AI omit? What did you correct? What remains unclear?
+
+A key strength of this contribution is that it is realistically implementable precisely because it does not attempt to address cognition in the abstract, but focuses on one clearly delimited academic task: summarisation. Behind the dashboard, the indicators would not be arbitrary. They would be grounded in psychometric measures and in a strong semiotic analysis of the summarisation task, so that the dashboard can be interpreted through a combination of psychological, cognitive, and semiotic indices. Psychometric scales can be used to measure the presence and intensity of typical cognitive and affective biases that may shape AI-assisted summarisation, such as confirmation bias, anchoring, and forms of impostor syndrome, while also providing a structured way to assess metacognition, particularly the student’s awareness, monitoring, and regulation of their own use of AI throughout the summarisation process. In this way, when the dashboard is analysed, it would not merely display surface metrics, but reflect deeper dimensions of the task: how meaning is reduced, reorganised, altered, verified, or appropriated by the student.
+
+The dashboard therefore does not aim to evaluate or punish students. Its purpose is to provide a structured representation of their own use of AI. By making visible the relationships between source, output, and revision, it transforms an opaque practice into an interpretable and discussable pedagogical experience, both for the student and for the teacher.
+
Share