ZIYAO ZHANG
Hello!
I’m Ziyao, a creative technologist and innovation designer in New York City.
About Me
Email
CV
Home
Video Works
Generative Arts
Creative Hands-on Projects
Record wonderful and interesting moments in life.
Fun
Photography
📷☁️ Fall Asleep04/2023
Individual Project
#Data Visualization
#VR Experience
#Immersive DesignIntroduction
Fall Asleep is an innovative interdisciplinary project that combines virtual reality (VR), dream analysis (EEG) and information visualization. Its core objective is to explore the human dream world and the interaction between dreams and spatial dimensions through virtual immersive experiences. Dreams have been the focus of philosophers and artists since ancient times, while modern science has revealed their close connection with the cerebral cortex. This project attempts to combine the two, using EEG data to capture human brain activity in real time and VR technology to transform dreams into a perceptible, interactive, multi-dimensional spatial experience. In the project, the experiencer not only feels the visual and spatial changes in the dream, but also explores the stories and emotions in their subconscious through interaction design, revealing the subtle connection between dreams and reality.
Concept
As a highly active state of the brain during sleep, dreams are full of mystery and complex symbolism, despite their fleeting nature. The concept of this project is based on scientific and psychological research into dreams, combining the experience of dreaming with the dimensions of physical space. Through real-time analysis of EEG data, the brain activity of the participant is converted into visual elements in a virtual space, generating a unique multi-dimensional dream immersion experience.
The project expresses different stages of the dream through four spatial dimensions (0 to 3):
- 0-Dimensional: Dots – the dream elements move in a dot matrix, showing the most basic dream fragments.
- 1-Dimensional: Lines – the dreamer's dream gradually unfolds in a linear space, connecting the dream fragments.
- 2-Dimensional: Plane – the dream develops into a complete two-dimensional story, and the dreamer explores the content of the dream in this space.
- 3-Dimensional: Cube – the dream enters a three-dimensional space, and the dreamer can interact with the dream scene to experience an immersive dream experience.
Goals
Explore the relationship between dreams and spatial dimensions: By combining dream experiences with spatial dimensions, we hope to explore the human brain's response to different dream stages and the multidimensional construction of dreams.
Enhance scientific understanding of dreams: By conducting in-depth research on the mechanism of dream production, brain wave activity and its expression in dreams, the project aims to improve people's scientific understanding of dreams. The focus is on studying the connection between EEG data and the visual, emotional and behavioral manifestations in dreams, and exploring the neural mechanisms behind dreams.
Develop an interactive dream experience based on EEG data: The aim is to build a dynamic dream generation system based on EEG data, which allows participants to experience and influence their dreams in real time. This interactive dream experience can give participants a better understanding of the activities in their subconscious minds.
Application Scenarios
- Immersive art experience: The innovative design of this project opens up new paths for the combination of art and technology. Through VR technology, users can enter their dream world in an unprecedented way and interact with their subconscious. This unique sensory experience provides a new creative platform for artists, designers and researchers, and can be widely used in cross-media art and multi-sensory experience design.
- Dream therapy and rehabilitation (Conceptual): Dream experiences are not limited to entertainment or artistic expression. By capturing and simulating brain activity in real time, the project is expected to have a profound impact in the field of neurological rehabilitation. Implanted dream technology may help patients who have lost consciousness or mobility to undergo rehabilitation training through external stimuli, and may even be able to awaken vegetative patients. We have already discussed this potential application with psychiatrists at Peking Union Medical College Hospital, and further experiments and research may be conducted in the future in conjunction with other disciplines.
- Sleep research and improvement (Conceptual): Understanding the mechanisms and content of dream generation can help improve sleep quality, especially for those who are plagued by nightmares or suffer from sleep disorders. Through in-depth analysis of dream stages, the project can provide clinical psychologists and sleep experts with more experimental evidence on dream structure and sleep patterns, thereby helping patients improve their sleep.