A Walk with a Shooting Star is a game where players take a peaceful stroll through a beautiful forest alongside a friendly dog named Shooting Star, an AI companion powered by a large language model (LLM). As they journey together, players engage in conversation and collaboratively solve puzzles and levels.
This project introduces a pipeline for embodied conversation that integrates VR environment spatial data as contextual input, enhancing the dialogue to be more context-aware, embodied, and authentic.
The companion adapts its behavior based on player actions and environment cues, providing a more immersive experience.
Players can communicate with the companion using natural language, powered by LLMs for dynamic and intelligent responses.