Project

SMILE ๐Ÿ‘

Science Misconception-Focused Immersive Learning Environment

SMILE is a research project focused on designing and studying an immersive science learning environment that helps students understand emergent phenomena and address common misconceptions in complex systems. The environment combines interactive simulation, LLM-based agents, and opportunities for generative learning activities (e.g., making predictions) as well as metacognitive monitoring (e.g., confidence-check reflections).

Research Questions

  1. How does learner engagement within an open-world, self-paced, LLM-supported learning environment relate to learning outcomes?
  2. How do parameter control and questioning agency affect learners' understanding of emergent phenomena in complex systems?
  3. How can conceptual frameworks such as PAIR-C (Patterns, Agents, Interactions, Relations, and Causality) be integrated into the design of interactive simulation-based learning environments?

The Flocking Simulator

An immersive open-world environment where learners control a virtual dog to explore animal groups exhibiting collective behaviors: sheep flocks, duck flocks, and bat swarms as analogies for emergent processes in complex systems.

๐Ÿ‘ Basic Lesson

Foundational complex systems concepts around the sheep flock: recognizing emergent flocking patterns and matching agents in the environment to their roles.

๐Ÿฆ† Intermediate Lesson

The three flocking rules from the Boids model (separation, cohesion, alignment) explored with the duck flock, covering Interactions and Relations.

๐Ÿฆ‡ Complex Lesson

Advanced ideas about Causality with the bat swarm: net effects vs. chain effects, common misconceptions, and transfer to phenomena like Earth's climate.

The Butterfly Tutor

Learners can call a dynamic LLM-based Butterfly Tutor (powered by GPT-4o) at any time for adaptive, context-aware support. Its design follows three principles:

  1. Theoretical alignment: responses are grounded in the PAIR-C framework to ensure conceptual consistency.
  2. Environmental awareness: the tutor uses regional metadata to contextualize its responses, intervening with certainty when it detects inactivity or off-task behaviors.
  3. Non-intrusive representation: a blinking butterfly icon gently reminds learners of the feature without demanding interaction, and softly redirects off-topic conversations back to complex systems concepts.

Inside the Environment

Animated snippets from the flocking simulator showing key features of the learning experience.

Lesson 1 with the sheep flock: a prediction question and the Show Interactions view revealing the network of local interactions

Lesson 1: Emergent Flocking (Sheep)

Learners answer prediction questions and toggle "Show Interactions" to reveal the invisible network of local interactions behind the flock's pattern.

Learner-initiated dialogue with the LLM-based Butterfly Tutor about what the sheep flock is doing

The Butterfly Tutor

Learners chat with the LLM-based tutor, which responds with context-aware, PAIR-C-grounded guidance about the emergent behavior around them.

Lesson 2 with the duck flock: a prediction question followed by manipulation of alignment, cohesion, and separation sliders

Lesson 2: Predict & Manipulate (Ducks)

Built-in prompts ask learners to predict flock behavior, then test their predictions by tweaking the alignment, cohesion, and separation sliders.

Lesson 3 with the bat swarm: exploring pattern stability by manipulating the speed parameter

Lesson 3: Causality & Transfer (Bats)

Learners explore advanced causality concepts with the bat swarm, testing whether emergent patterns hold as parameters such as speed change.

AI-generated corrective feedback elaborating on why an answer about Earth's climate as a complex system was incomplete

AI-Supported Corrective Feedback

For open-ended questions, the system generates real-time elaborated feedback on student responses via the OpenAI API.

Sheep flock scene with the non-intrusive 'Call Butterfly' prompt at the bottom

Non-Intrusive Tutor Access

A gentle "Call Butterfly" prompt reminds learners that the LLM tutor is available without demanding interaction.

Key Findings

In a 2*2 experiment with 69 postsecondary students varying control agency (Yes/No parameter control) and questioning agency (Yes/No LLM-based tutor), There are no significant differences on learning gains detected across conditions. Greater engagement with the LLM-based tutor, particularly through content-focused interactions, was associated with higher learning gains. Time spent in exploratory regions (not formal lessons) also significantly predicted posttest performance, highlighting the importance of fostering meaningful engagement with both conversational tutors and interactive features in LLM-supported environments.

Scientific Outputs

Project Team

Developers

Amit Nair (Flocking Simulator)

Researchers

Dr. Man Echo Su (PI, Project Lead)

Dr. Lidia Altamura (Postdoc collaborator)

Amit Nair (Research Assistant)

Prof. Tomohiro Nagashima (Advisor)

Design Partners

Developed through participatory design with a high school biology teacher and a domain expert in complexity science.