Hush
Hush is an interactive toy box that brings the movie "Toy Story" concept to life by bridging physical play with generative AI. Inspired by the idea of toys moving only when unobserved, the system captures images of the box's interior once the lid is closed. Images are processed via the Kling v2.5 Turbo model(via Replicate API) based on environmental filters like Rainy or Party. The resulting AI-generated video is then streamed to an iPhone 6, allowing users to peek through a central lens like a microscope into a hidden, animated world.
Hush is an interactive toy box that brings the movie "Toy Story" concept to life by bridging physical play with generative AI. Inspired by the idea of toys moving only when unobserved, the system captures images of the box's interior once the lid is closed. Images are processed via the Kling v2.5 Turbo model(via Replicate API) based on environmental filters like Rainy or Party. The resulting AI-generated video is then streamed to an iPhone 6, allowing users to peek through a central lens like a microscope into a hidden, animated world.
Hush is an interactive toy box that brings the movie "Toy Story" concept to life by bridging physical play with generative AI. Inspired by the idea of toys moving only when unobserved, the system captures images of the box's interior once the lid is closed. Images are processed via the Kling v2.5 Turbo model(via Replicate API) based on environmental filters like Rainy or Party. The resulting AI-generated video is then streamed to an iPhone 6, allowing users to peek through a central lens like a microscope into a hidden, animated world.
Group / Individual
Group / Individual
Group / Individual
Personal Project
Personal Project
Personal Project
Duration
Duration
Duration
2026. 02 ~ 03 (2 months)
2026. 02 ~ 03 (2 months)
2026. 02 ~ 03 (2 months)
The laptop serves as the central processing hub. It receives sensor data from Arduino via Serial Communication, triggers a frame capture using OpenCV, and transforms that image into a dynamic video through the Kling v2.5 Turbo Generative AI API(Replicate AI). The final output is then streamed via Flask web server to an iPhone 6 integrated within the device for real-time viewing
The laptop serves as the central processing hub. It receives sensor data from Arduino via Serial Communication, triggers a frame capture using OpenCV, and transforms that image into a dynamic video through the Kling v2.5 Turbo Generative AI API(Replicate AI). The final output is then streamed via Flask web server to an iPhone 6 integrated within the device for real-time viewing
The laptop serves as the central processing hub. It receives sensor data from Arduino via Serial Communication, triggers a frame capture using OpenCV, and transforms that image into a dynamic video through the Kling v2.5 Turbo Generative AI API(Replicate AI). The final output is then streamed via Flask web server to an iPhone 6 integrated within the device for real-time viewing
Starting Point
Starting Point
I started this project with a simple question: How can we use generative AI more playfully in the physical world, rather than just watching videos on social media?
I started this project with a simple question: How can we use generative AI more playfully in the physical world, rather than just watching videos on social media?
I started this project with a simple question: How can we use generative AI more playfully in the physical world, rather than just watching videos on social media?
First Experiment
First Experiment
The first experiment was inspired by an Instagram post that turned children's animal sketches into real videos. It started from my curiosity about how actual toys would move in a real-life environment, rather than just making drawings look realistic
The first experiment was inspired by an Instagram post that turned children's animal sketches into real videos. It started from my curiosity about how actual toys would move in a real-life environment, rather than just making drawings look realistic
The first experiment was inspired by an Instagram post that turned children's animal sketches into real videos. It started from my curiosity about how actual toys would move in a real-life environment, rather than just making drawings look realistic
I built a set with white foam board and 3D-printed figures, capturing the scene via a webcam on a tripod. Using Replicate API, I created a Python script by Vibe Coding to transform webcam snapshots into videos.
My prompt was simple: 'Generate a video based on the shapes and context of these figures' However, the AI often produced distorted or aggressive visuals and hallucinated objects that weren't actually there.
I built a set with white foam board and 3D-printed figures, capturing the scene via a webcam on a tripod. Using Replicate API, I created a Python script by Vibe Coding to transform webcam snapshots into videos.
My prompt was simple: 'Generate a video based on the shapes and context of these figures' However, the AI often produced distorted or aggressive visuals and hallucinated objects that weren't actually there.
I built a set with white foam board and 3D-printed figures, capturing the scene via a webcam on a tripod. Using Replicate API, I created a Python script by Vibe Coding to transform webcam snapshots into videos.
My prompt was simple: 'Generate a video based on the shapes and context of these figures' However, the AI often produced distorted or aggressive visuals and hallucinated objects that weren't actually there.
Inspiration
Inspiration
The first experiment showed me the potential of combining physical figures with Generative AI for play. Inspired by Toy Story installations that use projectors to spark imagination, I realized that instead of just playing videos, I should present them in a way that heightens children’s anticipation and wonder
The first experiment showed me the potential of combining physical figures with Generative AI for play. Inspired by Toy Story installations that use projectors to spark imagination, I realized that instead of just playing videos, I should present them in a way that heightens children’s anticipation and wonder
Prototyping
Prototyping
I began developing the prototype by adding a door to the box much like the Toy Story installation to pique children's curiosity about what’s inside. Rather than using unpredictable AI prompts, I designed a system where children can select and control specific options to shape the environment inside the box
I began developing the prototype by adding a door to the box much like the Toy Story installation to pique children's curiosity about what’s inside. Rather than using unpredictable AI prompts, I designed a system where children can select and control specific options to shape the environment inside the box
I began developing the prototype by adding a door to the box much like the Toy Story installation to pique children's curiosity about what’s inside. Rather than using unpredictable AI prompts, I designed a system where children can select and control specific options to shape the environment inside the box
Built a control panel with knobs, a switch, and LEDs using Arduino to adjust environmental filters
Built a control panel with knobs, a switch, and LEDs using Arduino to adjust environmental filters
Developed a web app to test video playback on a smartphone inside the box
Developed a web app to test video playback on a smartphone inside the box
Assembled the box-shaped prototype and integrated the physical controls
Assembled the box-shaped prototype and integrated the physical controls
Exploring alternative structures for the stable placement of the Arduino and sensors.
Exploring alternative structures for the stable placement of the Arduino and sensors.
Before
Concave Lens: Integrated a concave lens to project a wide smartphone display within a short focal distance.
Concave Lens: Integrated a concave lens to project a wide smartphone display within a short focal distance.
Mode Switching: Used a switch to toggle between Daily and Party modes.
Mode Switching: Used a switch to toggle between Daily and Party modes.
Environment Control: The knobs allows users to cycle through settings like Thunder, Aurora, Lava, and etc.
Environment Control: The knobs allows users to cycle through settings like Thunder, Aurora, Lava, and etc.
After
Concave Lens: Relocated the lens to the center to simulate a realistic, top-down view.
Concave Lens: Relocated the lens to the center to simulate a realistic, top-down view.
Mode Switching: Added a Day/Night toggle to adjust physical brightness levels.
Mode Switching: Added a Day/Night toggle to adjust physical brightness levels.
Environment Control: Used only one knob(Weather) to simplify operation for kids and improve AI prompt accuracy(Encountered a conflict where simultaneous knob inputs prevented one effect from being fully applied)
Environment Control: Used only one knob(Weather) to simplify operation for kids and improve AI prompt accuracy(Encountered a conflict where simultaneous knob inputs prevented one effect from being fully applied)
Replaced the bulky potentiometer-based hinge with a Hall effect sensor and magnet for a sleeker, more compact form factor
Replaced the bulky potentiometer-based hinge with a Hall effect sensor and magnet for a sleeker, more compact form factor
Using the FastLED library, I implemented a subtle, randomized shimmering effect.
Once the video generation is complete, the lighting automatically reverts to the preset Day or Night illumination, ensuring a seamless transition back to the base environment
Using the FastLED library, I implemented a subtle, randomized shimmering effect.
Once the video generation is complete, the lighting automatically reverts to the preset Day or Night illumination, ensuring a seamless transition back to the base environment
I identified a spatial constraint where side doors required the box to be elevated. I redesigned it with a top-loading detachable lid, enabling easier interaction and placement of figures on the floor.
I also added a 'Party Mode' to the existing weather knob, transforming the generated environment into a more vibrant and playful experience.
I identified a spatial constraint where side doors required the box to be elevated. I redesigned it with a top-loading detachable lid, enabling easier interaction and placement of figures on the floor.
I also added a 'Party Mode' to the existing weather knob, transforming the generated environment into a more vibrant and playful experience.
To achieve a more dramatic and natural light diffusion, I purchased translucent acrylic and fabricated a custom case using a laser cutter at a local makerspace. This significantly enhanced the quality of the light, making the glow appear much more organic and immersive
To achieve a more dramatic and natural light diffusion, I purchased translucent acrylic and fabricated a custom case using a laser cutter at a local makerspace. This significantly enhanced the quality of the light, making the glow appear much more organic and immersive
Video Making
Video Making
In the introductory video for this project, I realized that sound effects were essential since it is a toy designed for children, even if the actual prototype didn't produce sound yet. I carefully envisioned these auditory elements during the video-making stage.
Due to limited space, I filmed in my small room, using a simple sheet of white paper taped to the wall as a backdrop
In the introductory video for this project, I realized that sound effects were essential since it is a toy designed for children, even if the actual prototype didn't produce sound yet. I carefully envisioned these auditory elements during the video-making stage.
Due to limited space, I filmed in my small room, using a simple sheet of white paper taped to the wall as a backdrop
Reflection
Reflection
When I first began this project, I worried if I was somehow deceiving children. However, I realized that just as movies and novels spark our imagination without being 'real,' this project could serve a similar purpose. Moving forward, I want to evolve Hush into various formats, such as specialized tools for storytelling, video production, or even an outdoor interactive experience
When I first began this project, I worried if I was somehow deceiving children. However, I realized that just as movies and novels spark our imagination without being 'real,' this project could serve a similar purpose. Moving forward, I want to evolve Hush into various formats, such as specialized tools for storytelling, video production, or even an outdoor interactive experience
When I first began this project, I worried if I was somehow deceiving children. However, I realized that just as movies and novels spark our imagination without being 'real,' this project could serve a similar purpose. Moving forward, I want to evolve Hush into various formats, such as specialized tools for storytelling, video production, or even an outdoor interactive experience