AI Social Mirror

brain-sensing | artificial intelligence | human-computer interaction | performance

Live simulator of social behaviour consequences

Live simulator of social behaviour consequences

roles: creative director | developer | prompt engineering | performer | stage designer

 

Motivation

Social Mirror is a closed-loop AI experience that improves decision-making with a brain-sensing headband and StyleGAN2 to simulate facial micro-expressions. A person can simulate the possibilities of their social circle’s reactions by viewing their face in digital likeness. Once a person speaks into a microphone, their response to a social scenario triggers social consequences and facial expressions shown on the StyleGAN2-generated face with a pre-selected GPT-3.5 audio prompt sequence powered with Python. The person’s head movements and eye blinks are simulated on the generated face via an Electroencephalography (EEG) headband’s accelerometer, gyroscope and detected brainwave activity. This simulated biofeedback reinforces a “social mirroring effect“ where the person may be more receptive to the social consequences of their decisions with implicit cognitive cues.

The Social Mirror Apparatus

 

Performance Demo and Audience Feedback

 

Methodology

The mirrored biofeedback mechanism with the brain-sensing headband and StyleGAN2 Face

The Muse S brain-sensing EEG headband used in the Social Mirror Apparatus

Types of Mirrored Audio Social Responses