📊 Learning Analytics Framework

Knowledge Explorer as a
Stealth Assessment Instrument

Every click, hover, navigation sequence, and question asked inside the Knowledge Explorer is a behavioral signal that reveals the learner's cognitive and non-cognitive characteristics — without a single explicit test.

Based on the Learner Behavior Tracking & Assessment Framework — a comprehensive specification for transforming interaction data into deep learner insight.

158
Observable behaviors tracked
8
Learner models derived
18
Interaction contexts
6
Bloom's levels measured

What is Stealth Assessment?

Stealth assessment embeds measurement invisibly within the learning experience itself, removing the artificial distinction between "learning" and "being tested."

The Core Idea

Traditional assessments interrupt learning — a learner stops exploring, answers a quiz, then resumes. Stealth assessment eliminates that interruption. The learning environment is the assessment. Every act of exploration reveals what the learner knows, how they think, and how they engage.

"Stealth assessment is the seamless integration of assessment within learning environments so that learners are not aware they are being assessed." — Valerie Shute, Florida State University

The Knowledge Explorer is uniquely positioned as a stealth assessment platform because learners interact with a rich, multi-modal environment where every action is a meaningful choice: which node to click first, whether to ask for simpler explanations or deeper detail, how they formulate questions, whether they explore prerequisites before central concepts, and how they navigate between adjacent ideas.

🧠
Cognitive Characteristics
Prior knowledge, conceptual depth, reasoning strategy, metacognitive awareness, Bloom's taxonomy level, knowledge state per concept.
❤️
Non-Cognitive Characteristics
Motivation, persistence, self-regulation, curiosity, help-seeking behavior, growth mindset, engagement state, learning strategy preference.
📈
Learning Trajectory
Velocity of mastery acquisition, breadth vs. depth preference, efficiency trend, spaced repetition patterns, retention curves.

158 Observable Learner Behaviors

Organized across 18 interaction contexts, every observable action within KE is captured, timestamped, and used as evidence in learner models.

🗺️
Map Generation & Setup
13 behaviors
#BehaviorAssessment Signal
1–3Select domain / subdomain / conceptPrior knowledge scope; familiarity with terminology
4Type custom domain/concept (not from suggestions)Self-directed learning; specific gap awareness
5Add additional context before generationPrior knowledge depth; existing mental model
6–9Switch to "Describe Problem" mode; analyze & select candidateProblem awareness; real-world motivation; conceptual discrimination
11Click "Generate Map"Full input payload reveals conceptual framing
12Change LLM providerTechnical sophistication; awareness of AI options
13Wait duration during generationPatience; expectation management
🔍
Map Navigation & Exploration
16 behaviors
#BehaviorAssessment Signal
15Click concept nodes (blue rectangles)Conceptual interest; prior knowledge
16Click skill nodes (green pills)Application orientation; practical learner
17Click prerequisite nodes (purple hexagons)Foundation-seeking; recognizes dependency
18Click edges (relationship lines)Relational thinking; seeks connections
19–20Hover over nodes / edges (without clicking)Hesitation; consideration depth
21Drag nodes to repositionSpatial reasoning; desire for personal organization
22–24Zoom in/out; pan canvasFocus: detail-oriented vs. big-picture thinker
25Change layout algorithmVisual learning preference; structural curiosity
26–29Node visit sequence; revisits; navigation pathsBreadth-first = surveying; depth-first = focused; random = disoriented
27Dwell on map overview before first clickStrategic planning vs. impulsive behavior
📋
Node & Edge Details Panel
5 behaviors
#BehaviorAssessment Signal
30Dwell time reading node descriptionProcessing depth; reading speed
31Dwell time reading edge descriptionRelational thinking; attention to connections
32Click "Explore in New Tab"Curiosity depth; desire to go deeper into periphery
33View map statisticsMeta-awareness of structure; analytical disposition
34Time before taking any actionReflection vs. impulsive exploration
Learning Actions (Concepts, Skills, Prerequisites, Edges)
14 behaviors
#BehaviorAssessment Signal
35View DefinitionFoundational learning; beginner orientation
36Show PrerequisitesSelf-assessment; metacognitive awareness
37See ExampleConcretization need; abstract-to-concrete processing
38Practice QuestionActive retrieval; self-testing; strong learning strategy
39Guided Practice (skill)Application orientation; hands-on learner
40Step-by-Step Tutorial (skill)Procedural learning; scaffolding preference
42Review Concept (prerequisite)Gap recognition; builds foundations first
43Diagnostic Check (prerequisite)Metacognitive sophistication; verifies understanding
44Why It Matters (prerequisite)Meaning-seeking; deep learning orientation
45Deep Dive (prerequisite)Mastery pursuit; not satisfied with surface knowledge
46Explain Relationship (edge)Relational understanding; seeks "why" not just "what"
47Show Formal Definition (edge)Technical sophistication; precision-seeking
48Common Misconceptions (edge)Error prevention; error-aware; sophisticated learner
💬
AI Chat Modal
13 behaviors
#BehaviorAssessment Signal
49Dwell time before first replyProcessing depth; careful reading vs. skimming
50–51Compose & send follow-up questionsComprehension depth; inquiry sophistication
52"More detail" clicksInsufficient initial understanding
53"Simpler" clicksCognitive overload; scaffolding needed
54"Got it" clicksSelf-reported comprehension checkpoint
55Click suggested follow-up promptGuided learning; needs scaffolding for questions
56"Regenerate" clicksQuality dissatisfaction; critical evaluation
57Math input / LaTeX compositionTechnical sophistication; formal notation fluency
58–59Conversation turns; inter-message latencyEngagement depth; cognitive processing time
60–61Close modal; scroll behavior in chatSession satisfaction; content revisiting
📝
Assessment Modal
18 behaviors
#BehaviorAssessment Signal
63–65Select presets; add custom instructions; skip vs. customizeSelf-awareness of level and learning context
67Answer a question (option selected)Knowledge state; difficulty calibration
68Change answer before submittingUncertainty; second-guessing; partial knowledge
69Time per questionFast+correct = fluent; slow+correct = effortful; fast+wrong = guessing
70Peek at explanation before answeringUsing test as learning tool; help-seeking
71–72Read explanation after answering; dwell timeLearning from errors; growth mindset
73Question navigation patternLinear = methodical; jumping = strategic or anxious
74Skip questionsIdentifies specific knowledge gaps
75Score by difficulty tierRecall (easy) vs. application (medium) vs. synthesis (hard)
77Assessment retakesPersistence; score improvement = learning; no change = stuck
79Abandon assessmentFrustration; overwhelm; disengagement signal
Q2L — Question to Learn Modal
9 behaviors
#BehaviorAssessment Signal
82Time reading scenario before first questionComprehension effort; careful reading
83Context item selection (which concepts seen as related)Relational awareness; conceptual mapping ability
84Question formulation qualityHigher-order thinking; understanding of concept boundaries
85Number of questions askedCuriosity persistence; engagement depth
86AI-evaluated question quality scoreDeep vs. shallow understanding
87Own questions vs. suggested prompts ratioInquiry independence; autonomous thinking
🔧
WTB — When Things Break Down
13 behaviors
#BehaviorAssessment Signal
129Open WTB modalEngagement with troubleshooting mode; causal thinking orientation
130–131Select presets (Engineering/Biological/Social/etc.) vs. skip preferencesDomain preference; self-awareness of learning context
132Dwell time reading breakdown scenario before first actionComprehension effort; careful reading vs. rushing to diagnose
133Expand evidence clues (type + order + total expanded)Evidence-gathering strategy; systematic vs. selective reading
134Ask diagnostic investigation questions (turn count, clues read at time of asking)Investigative depth; ability to formulate targeted diagnostic queries
135Switch to diagnosis mode (investigation turns + clues expanded at switch)Readiness calibration; how much evidence gathered before committing
136–137Compose & submit root cause diagnosis (text length, composition time, wentDirectToDiagnose)Causal reasoning quality; overconfidence if direct without investigation
138Diagnosis accuracy verdict (correct / partial / incorrect + reasoning depth)Direct measure of Apply/Analyze Bloom's levels; mechanism vs. symptom identification
139Retry diagnosis vs. continue to discussionMetacognitive calibration; persistence after failure
140–141Post-verdict discussion turns; close WTB (session duration, phase at close)Post-diagnosis conceptual integration; depth of follow-through
WTB Causal Reasoning Signals: The combination of clues expanded before diagnosis (evidence coverage), investigation turns taken (diagnostic thoroughness), and diagnosis accuracy (correctness) forms a multi-dimensional measure of causal reasoning ability — one of the hardest cognitive skills to assess through traditional tests.
🔭
Wonderment — Curiosity to Insight
17 behaviors
#BehaviorAssessment Signal
142Open Wonderment modalOrientation toward inquiry-based learning
143–146Select inquiry lens presets; add custom instructions; toggle fresh generationMetacognitive awareness of own learning preferences; preference for novelty
147–148View observations list; dwell before selectingReflective reading — long dwell = careful consideration of which curiosity resonates
149Write own custom observation (compositionMs)Independence signal — self-directed inquiry; has existing curiosity the AI didn't surface
150View academic reframing of observationExposure to disciplinary framing; field label provides vocabulary scaffolding
151Select genius question (type + geniusDwellMs)Question type reveals thinking preference; long dwell = deliberate; "paradox" and "inversion" types correlate with higher-order thinking
152Navigate back to genius questions (with draft)Metacognitive self-correction — critical self-assessment; intellectual honesty
153Compose and submit answer (compositionMs)Long composition = genuine engagement; short = low effort or overconfidence
154–155Read critics' panel (criticsDwellMs); request synthesisLong criticsDwellMs = open to critique; rushing = seeking validation not learning
156Read synthesis and wonderment moment (synthesisDwellMs)Conceptual integration signal — longest dwell indicates concept has been genuinely reframed
157–158Restart / close (phase at close, didReachSynthesis)Drop-off phase identifies most difficult or disengaging step; completion = full inquiry arc traversed
Bloom's Levels 5–6 Direct Measurement: Wonderment is the only activity that operationalizes Evaluate (critics' panel engagement, synthesis dwell) and Create (custom observation, genius question selection, answer composition) simultaneously — the two Bloom's levels hardest to assess through traditional tests. The critics' dwell vs. synthesis dwell ratio distinguishes learners who seek validation from those who genuinely integrate new knowledge.
🎓
Lecture, Resources, & Learning Path
26 behaviors
#BehaviorAssessment Signal
92Slide dwell timeContent processing; long on complex slides = careful reading
93Lecture slide navigation (linear vs. backtracking)Didn't understand on first pass = re-processing need
94Complete lecture (all slides)Commitment to structured content
96Abandon lecture midwayContent mismatch; boredom; frustration
99–100Resource type filter; click external linkLearning modality: video=visual, article=textual, tutorial=hands-on
103–104"Suggest Learning Order"; "Where Should I Start?"Orientation need; self-regulation level
105Follow vs. deviate from suggested pathCompliance vs. self-directed exploration
107Mark nodes completeSelf-monitoring; progress tracking disposition
108Complete out of order (before prerequisites)Knowledge overconfidence; skips foundations
🗂️
Tab Management, Session & Dashboard
20 behaviors
#BehaviorAssessment Signal
109–112Open/switch/close tabs; concurrent tab countComparative learning; simultaneous concept exploration
115Total session durationOverall engagement depth
116Return visit patternsCommitment; sustained motivation; spaced repetition
117–118Dashboard visits; expand domainsMetacognitive reflection; progress awareness
121"Learn Again" re-engagementSpaced repetition awareness; optimal strategy
122View "How Am I Doing?" analyticsSelf-monitoring; metacognitive engagement
125–128Class enrollment; curriculum adherence; paceSocial context; structured vs. self-directed learning

8 Learner Models Derived from Behavior

Raw behavioral data feeds into a stack of learner models, each measuring a different dimension of the learner's profile. Together they form a complete, dynamic picture of the learner.

Model 1
Knowledge State Model
Bayesian Knowledge Tracing (BKT)
Estimates probability that the learner has mastered each concept/skill at any moment. Uses assessment scores, "Got it" / "Simpler" feedback, revisit patterns, and Q2L quality as evidence to update P(Known) per concept.
P(Known) per concept — 0.0 to 1.0
Concept map propagation via edge structure
Fast+correct = strong signal; slow+wrong = guessing
Model 2
Learning Strategy Profile
Latent Class / Gaussian Mixture Model
Classifies each learner into a strategy archetype based on a 13-dimensional feature vector derived from time allocation, exploration entropy, question formulation, and interaction patterns.
Primary archetype classification (soft membership)
Preferred modality: visual / textual / hands-on
Personalized recommendations per archetype
Model 3
Engagement & Motivation Model
Hidden Markov Model (HMM)
Tracks motivational state over time through 5 hidden states — from Highly Engaged to Disengaging — using session duration, question depth, completion rates, and return frequency as observable emissions.
Current engagement state (S1–S5)
Transition probabilities between states
Alert when P(Disengaging) exceeds threshold
Model 4
Bloom's Taxonomy Level Estimator
Evidence Accumulation Model
Estimates the highest cognitive level demonstrated per concept, from Remember (L1) through Create (L6), using behavioral evidence: definitions viewed, examples requested, chat question quality, misconceptions explored, and Q2L originality.
Bloom level (1–6) per concept
Evidence count per level threshold
Cognitive depth progression over time
Model 5
Concept Mastery Map
Weighted Overlay Model
A composite mastery score (0–100) per node, combining assessment performance (30%), Bloom level (20%), chat engagement depth (15%), time invested (10%), spaced repetition bonus (10%), prerequisite mastery (10%), and resource diversity (5%).
Visual color overlay on the concept map
Propagation rules via requires/enables edges
Mastery decay (exponential, 30-day half-life)
Model 6
AI Collaboration Competency
Multi-Dimensional Scoring
Evaluates how effectively the learner uses AI as a cognitive partner across 6 dimensions: prompt precision, iteration depth, critical evaluation, concept integration, metacognitive awareness, and efficiency.
Score per dimension (0–100)
Overall AI collaboration competency score
Independence trajectory over sessions
Model 7
Temporal Learning Trajectory
Growth Model / Time Series
Tracks learning velocity, breadth expansion, depth progression, and efficiency trends over time. Predicts which concepts will need review, estimates time-to-mastery, and flags learners who are plateauing.
Learning velocity (Δmastery / Δtime)
Forgetting curve predictions per concept
Strategy maturation: passive → active learning shift
Model 8
Social-Comparative Model
Percentile Ranking in Class Context
Positions learner performance relative to class peers across curriculum progress, assessment scores, engagement consistency, exploration breadth, and AI collaboration quality. Enables teacher interventions and peer grouping.
Percentile rank per metric within class
Class-wide concept mastery heat map
At-risk learner identification and pacing alerts

What Each Behavior Reveals

Each interaction is tagged with the cognitive or non-cognitive characteristic it indicates. Together they paint a complete learner portrait — without a single explicit test.

Bloom's Taxonomy Progression

6
Create
Describes novel problems · Cross-domain connections · Original Q2L questions · Multi-tab synthesis · Wonderment: custom observation + genius question type "reframe/inversion"
5
Evaluate
High Q2L scores · Critical inquiry · Challenges AI output (Regenerate + critique) · Multiple perspectives · Wonderment: long critics dwell + synthesis integration
4
Analyze
Edge exploration · "Why" & "How" questions · Common Misconceptions · Diagnostic Check · WTB: correct root-cause diagnosis with deep reasoning
3
Apply
Guided Practice · Step-by-Step Tutorial · Application questions in chat · Medium questions correct · WTB: diagnostic investigation questions asked
2
Understand
Asked for examples · "More detail" clicks · Time reading explanations · Medium questions correct
1
Remember
Viewed definition · Correct on easy assessment questions

WTB — Causal Reasoning Signals

Cognitive
Clue coverage before diagnosis
Reads all clues = systematic evidence synthesis; skips clues = impulsive or overconfident
Cognitive
Investigation turns before committing
More questions = thorough diagnostic process; zero questions + wrong = knowledge gap or guessing
Cognitive
Diagnosis accuracy (correct / partial / incorrect)
Direct measure of Apply/Analyze Bloom's levels; most reliable signal in the system
Cognitive
Reasoning depth: mechanism vs. symptom
Identifies WHY it broke (deep) vs. WHAT broke (shallow) — distinguishes conceptual understanding from surface recognition
Metacognitive
Went directly to diagnose without investigating
If correct = strong prior knowledge; if incorrect = overconfidence; triggers adaptive scaffolding
Metacognitive
Retry vs. continue after wrong verdict
Retry = growth mindset + self-regulation; continue despite being wrong = needs metacognitive intervention
Behavioral
Scenario preset selection
Domain preference and contextual learning orientation (engineering, biological, social, etc.)
Behavioral
Post-verdict discussion depth
Follow-up questions about mechanism or prevention signal genuine conceptual integration beyond the task

Wonderment — Inquiry Depth Signals

Cognitive
Custom vs. selected observation
Writing own = active prior curiosity; selecting AI's = receptive but less self-directed — strongest independence signal in the system
Cognitive
Genius question type chosen
"Paradox" and "inversion" types correlate with higher-order thinking; "scale" and "analogy" indicate systems thinking across domains
Cognitive
Genius question dwell time
Long consideration before selecting = deliberate, careful thinker; very short = impulsive or already had a strong prior preference
Metacognitive
Back to questions (with draft)
Self-correction behavior — had an answer started but chose to reconsider the question; high metacognitive awareness
Metacognitive
Critics panel dwell vs. synthesis dwell ratio
High critics dwell + high synthesis dwell = genuine integration; low critics + high synthesis = seeking validation; low both = surface engagement
Cognitive
Synthesis dwell time
Strongest single indicator of deep conceptual impact — when the wonderment moment genuinely reframes understanding, learners read slowly and return
Behavioral
Phase at close (drop-off analysis)
Identifies which step is too difficult, too abstract, or least engaging — directly informs adaptive content and pacing decisions
Affective
Answer composition time
Long composition = high engagement and genuine effort; very short = low investment or overconfidence in the question chosen

Learning Strategy Archetypes

📐
Systematic Explorer
Follows prerequisite→concept→skill order · Reads definitions first · Uses learning path · Linear assessment navigation
→ Provide structured curricula; suggest next logical concept
🌐
Curiosity-Driven Wanderer
Opens many tabs · Jumps between non-adjacent nodes · Explores edges · Many follow-up questions
→ Provide open-ended exploration tools; suggest surprising connections
🏆
Assessment-Focused Achiever
Goes straight to assessments · Retakes for higher scores · Short chat sessions · Skips lectures
→ Gamify with score tracking; challenge with harder questions
📖
Passive Consumer
Primarily uses lectures · Reads definitions · Few follow-up questions · Rarely takes assessments
→ Prompt with practice questions; interleave active recall
🆘
Help-Seeking Struggler
Frequent "Simpler" clicks · Long time per question · Revisits prerequisites · Uses "Where Should I Start?"
→ Scaffold more; recommend prerequisite review first
Efficient Expert
Short focused sessions · High assessment scores · Explores misconceptions · Uses formal definitions
→ Provide advanced content; suggest edge cases; cross-domain connections

Engagement State Model (HMM)

S1 — Highly
Engaged
Deep Exploration
Long sessions · High question count · Explores all node types · Completes assessments · Moderate "Got it" rate · 1–2 days between sessions · WTB: systematic clue reading + correct diagnosis
S2 — Productively
Engaged
Focused Progress
Medium sessions · Regular interactions · Steady pace · Frequent "Got it" clicks · Dashboard visits · 2–3 days between sessions
S3 — Surface
Engaged
Going Through Motions
Short sessions · Few questions · Random node exploration · Partial assessment completion · Rare dashboard visits · 3–5 days between sessions
S4 — Struggling
Friction & Confusion
Long pauses · Prerequisite revisits · Frequent "Simpler" clicks · Abandoned assessments · Frequent self-check via dashboard
S5 — Disengaging
⚠️ Intervention Needed
Very short sessions · Minimal node visits · Declining return frequency · Skips assessments · No follow-up questions · 7+ days between sessions

Concept Mastery Score — Composite Formula

mastery(node) =
  0.30 × assessment_score
 + 0.20 × bloom_level / 6
 + 0.15 × chat_engagement_depth
 + 0.10 × time_invested [diminishing returns]
 + 0.10 × revisit_pattern [spaced repetition bonus]
 + 0.10 × prerequisite_mastery
 + 0.05 × resource_diversity
0–30: Unexplored / Failing
31–50: Partial
51–70: Developing
71–85: Proficient
86–100: Mastered

The Unified Learner Profile

All models converge into a single, continuously updated JSON profile — a comprehensive representation of the learner's current state, trajectory, and characteristics.

// Composite Learner Profile — continuously updated from behavioral signals { "learnerId": "uuid", "lastUpdated": "ISO-8601 timestamp", "knowledgeState": { // Model 1 (BKT) + Model 5 (Mastery) "concepts": { "<conceptId>": { "pKnown": 0.0–1.0, // Bayesian probability "bloomLevel": 1–6, // Highest demonstrated level "masteryScore": 0–100, // Weighted composite "decayedMastery": 0–100, // After forgetting curve "evidenceCount": 0 } }, "strongestDomain": "string", "weakestDomain": "string" }, "learningStrategy": { // Model 2 (Latent Class) "primaryArchetype": "Systematic Explorer | Curiosity-Driven | ...", "archetypeProbabilities": { /* soft membership across all 6 */ }, "preferredModality": "visual | textual | hands-on | mixed", "preferredDepth": "surface | moderate | deep" }, "engagement": { // Model 3 (HMM) "currentState": "S1–S5", "stateProbabilities": [0.0, 0.0, 0.0, 0.0, 0.0], "trend": "improving | stable | declining", "sessionsPerWeek": 0, "totalSessions": 0 }, "aiCollaboration": { // Model 6 (6-dimension score) "promptPrecision": 0–100, "iterationDepth": 0–100, "criticalEvaluation": 0–100, "integration": 0–100, "metacognitive": 0–100, "efficiency": 0–100, "overallScore": 0–100 }, "growthTrajectory": { // Model 7 (Temporal) "learningVelocity": 0.0, // Δmastery / Δtime "breadthExpansionRate": 0.0, // New concepts per session "depthProgressionRate": 0.0, // Avg Bloom level increase "efficiencyTrend": "improving | stable | declining", "independenceTrajectory": "improving | stable | declining" }, "classContext": { // Model 8 (Social-Comparative) "curriculumProgress": 0.0–1.0, "percentileRank": 0–100, "paceRelativeToClass": "ahead | onPace | behind" } }

Model Implementation Priority

Ranked by assessment value and implementation effort, based on the percentage of behavioral data already being captured in the current system.

Model Data Captured Assessment Value Effort Priority
Knowledge State (BKT)
70%
Very High Medium P0
Concept Mastery Map
80%
Very High Low P0
Bloom's Taxonomy Estimator
60%
High Medium P1
AI Collaboration Model
90%
High Low (enhance) P1
Learning Strategy Profile
50%
High Medium P1
Engagement / Motivation HMM
40%
Medium-High High P2
Temporal Learning Trajectory
60%
Medium-High Medium P2
Social-Comparative Model
70%
Medium Medium P2
Background Theme