Under the Bay

UNDER THE BAY

 

An Augmented Reality Project
A Story Told by the Largest Estuary in North America

 

“Under the Bay” by Lisa Moren and Dr. Tsetso Bachvaroff with software engineering by Marc Olano, and music composed by Dan Deacon. © lisamoren, 2022.

 
 

“Under the Bay” tells the story of a world beneath the surface of the Chesapeake Bay and really all estuaries and oceans. In this augmented reality project a user can point their cell phone at the water — or anywhere in the world — like a microscope and see and hear the hidden invisibilities under the Chesapeake Bay. When they do, a series of stories between humans and non-humans emerge told by artist Lisa Moren with music by electronic composer Dan Deacon. Directed by Lisa Moren and marine biologist Tsvetan Bachvaroff, the team worked with software engineer Marc Olano to develop the project.

The narrator describes the Chesapeake Bay in both enlightenment and medieval terms where personal observation is intertwined with scientific knowledge unpacking recent political events and arguing for diversity broadly. Some episodes see microbes like faeries and the planet as an ensouled body soaked in a wet film that inhales and exhales like a living organism. Other meandering topics include cryonics, meditation, the origins of the Internet, monuments, protests, US elections, and algae blooms all describing a world out of balance.

Underwater sensors located throughout the Chesapeake Bay collect data on the water’s oxygen and salt levels, pH, temperature, etc. This live data streaming into the app allows the stories, images, and electronic music to be driven by the current conditions of the water. The data from the Bay will direct how the organisms appear and how the story is told. In addition to affecting the animation’s speed and color, originally composed music will also change reverb, EQ, and other parameters, based on the water conditions. For instance, the voiceover narrative will sound choppy, or even choking, when the oxygen is low or anoxic, but when oxygen conditions are good, the voice is clear.

Behind the scenes, marine biologist, Dr. Tsetso Bachvaroff, shares his expertise on the Bay water, its data and the DNA of the invisible organisms. Dinoflagellates and diatoms produce most of the world’s oxygen and are the ancestors of humans by hundreds of millions of years. Before they outlive humans, they reveal their remarkable survival strategies to us and inspire how we may learn to live in this project.

Viewers may select one of 8 scenes with images and sounds evolving each time they open the app. In the evening the app offers originally composed music and animation inspired by bioluminescence that’s also affected by the incoming water data. A calendar will allow the user to go back in time to hear what the Bay was saying on a particular date, perhaps during an algae bloom. The user may also change sites in the Bay or turn off the data altogether to experience different effects.

“Under the Bay”, tells a unique story for every user, changing over time, over seasons, but always influenced from the viewpoint of the water itself.

 

Data Sites

 
 
 

When the viewer opens “Under the Bay” data is automatically streaming in from underwater sensors located at the National Aquarium East. The Maryland Department of Natural Resources monitors the data in this Inner Harbor site where floating wetlands are planned. Over time, the wetlands will change the appearance of the animations and sounds. The user can choose any of the six different sites throughout the Chesapeake Bay in Maryland and Washington DC to monitor differences on a given day. The user can also go as far back in time as 2017 to see the different climate effects over seasons and years, such as the dates of known algae bloom.

 

++

 

“Under the Bay” User Interface overlayed on Scene 07 “Vaccine Blooms with Pink Hats”

 
 

++

 

Excerpt from “Under the Bay Trailer” 2023.

 

This video shows an excerpt of each scene without the AR camera.

UNDER THE HOOD \\ This video features how and where data comes from, including its effect on Dan Deacon’s music.

UNDER THE HOOD \\ This video describes how data is used to manipulate images and sounds.

 

++

 
 
 
 
 
 
 
 



++

 

UNDER THE BAY TEAM

 

Project directors

 
 

 

Production TEAM


John Boutsikas Lead Programmer + UI \\ UX

Austin Samson Modeler + Animator

William Forrest Modeler, Animator, UI + Technical Artist

Woody Lissauer Voiceover Engineer + Male Narrator, Ted Nelson
[ Scene02 \\ Water Moving Around My Fingers ]

Ruskin Nohe-Moren Male Narrator, Theodore Schwenk
[ Scene02 \\ Water Moving Around My Fingers ]

Aliyah Baruchin Copy Editor + Fact Checker



 ++

 

This project is generously supported by the Saul Zaentz Innovation Fund
at Johns Hopkins University
and the R.W. Deutsch Foundation.

 
 

This project originated during an artist in residence program supported by the Institute of Marine and Environmental Technology [IMET] and the Center for Innovation, Research, and Creativity in the ARTS at the University of Maryland, Baltimore County [UMBC]. We’re grateful for the support from IMET; Maryland Department of Natural Resources; Danielle McPhatter and Harvestworks Digital Media Art Center, The IRC, CIRCA, and CAHSS at UMBC, and Antoine Cayrol of Atlas V Immersive Experiences in AR, XR, and VR.