The escape

Esha created this video using Unreal Engine software (including avatars she created using photogrammetry to look like Lindsey and Esha) for the opening of our Alcina Reimagined technology demonstration.

It includes the backstory for Alcina and Morgana: it illustrates how they came to be on the enchanted island.

The proposal

Created using virtual, green screen production and Unreal Engine, Esha created a proposal scene to be projected as a memory on the scrim in our technology demonstration of Alcina Reimagined.

Eventually, work such as this can be developed for use in augmented reality, over-layed in the audience’s view, rather than projected on a separate surface.

(Performers: Perri di Christina, James Brown)

Morgana Avatar

Esha created this avatar of herself (Morgana) using photogrammetry and Unreal Engine. Projected onto the scrim, it represented Bradamante’s perspective of Morgana. The avatar was connected to live link, linking Esha’s facial movements to that of the avatar. For this demonstration, we used a pre-recordedvideo projection.

Eventually, work such as this can be developed to be used in real-time, so the performer’s face is directly linked to the avatar as the performance occurs.

Ah, mio cor

Esha created this background virtual set using Unreal Engine. In it, she illustrated the internal state of the character singing, who becomes enraged in the second section of the song. Esha used animations of fire erupting and then cooling as “Alcina’s” mood shifts throughout the song.

Eventually, work such as this can be developed for use in augmented reality, being physically controlled by the characters real time during the performance, rather than created as video.

Prison break

Created using virtual, green screen production and Unreal Engine, Esha created a scene to enhance the backstory / history of Ruggiero, Alcina, and Morgana as they have just helped prisoners escape. This video illustrates Alcina and Ruggiero’s relation with one another and their mutual respect (a similar, black and white video illustrated a different perspective of this same event, in which Ruggiero was being kidnapped). It was projected as a memory on the scrim in our technology demonstration of Alcina Reimagined.

Eventually, work such as this can be developed for use in augmented reality, over-layed in the audience’s view, rather than projected on a separate surface.

(Performers: Perri di Christina, Lindsey Blackhurst, Esha Datta)

river song, “Die Expanded Schöne Müllerin”

This piece illustrates the first use of Unreal Engine technology projections as well as an adapted song cycle.

In this performance, we added to Franz Schubert’s 20 song cycle in order to add perspectives of the characters about which the tenor sings in its original form. This is the closing song, shown with projections.

River Song - by Reena Esmail

Singers: Lindsey Blackhurst, Esha Datta, Kirsten Shippert Brown, Stephanie Feigenbaum

Work sample Compilation

This video is a compilation of work that included a number of different techniques for Die (Expanded) Schöne Müllerin as well as technological work with opera science students at FLORIDA ATLANTIC UNIVERSITY.

This included incorporating GREEN SCREEN and LIVE COMPOSITING, teaching students to perform with MOTION CAPTURE and incorporating these techniques in live performance.

ARTISTS: Esha Datta, Lindsey Blackhurst, Kirsten Shippert Brown, Stephanie Feigenbaum, Drew Watson, FAU Opera Scenes Students TITLE: Die (Expanded) Schöne Müllerin, Mozart & Salieri - design and implementation clips DATE: February, 2023

MEDIUM: A mix of different modalities including music, video, motion capture technology, and performance art LOCATION: National Opera Center, New York City & Florida Atlantic University

Underscored with singing from Die Expanded Schöne Müllerin: Lindsey Blackhurst, Elle était descendue au bas de la… (Lili Boulanger); Drew Watson and Esha Datta, "Der Müller und der Bach;" Drew Watson (the Miller); Lindsey Blackhurst, Esha Datta, Kirsten Shippert Brown, Stephanie Feigenbaum, "The River Song" (Reena Esmail)

0:00 intro, Lindsey Blackhurst (the Narrator) singing

0:31 Backdrop projections samples

:50 Adding additional voices; Esha Datta (the Brook), Drew Watson (the Miller)

1:22 Adding additional voices: River Song (Blackhurst, Datta, Brown, Feigenbaum)

1:49 Example of MOTION CAPTURE creation and implementation for the MAID (Die [Expanded] Schöne Müllerin)

3:24 AVATAR creation using Lindsey's face and photogrammetry (for upcoming 2023 ALCINA Demonstration)

4:32 MOTION CAPTURE with FAU students - workshop

5:24 GREEN SCREEN and LIVE COMPOSITE with FAU students