I have been developing a video game for a houseplant to play.
I found a circuit online that uses Galvanic Skin Response to translate changes in conductance into midi notes. I soldered it together and I have been using it to play video games with my skin using an open-source program called ‘MidiKey2Key’ which translates incoming midi notes into any kind of keyboard button presses. I also use Ableton Live to output the midi notes to a particular octave and not the entire scale (this is also useful with the sonification of these elements). Interestingly this process also works on plants of any sort, although I found it works better on some more than others.
After ‘training’ the plant (slowly adjusting the signals and assigned button presses, since there is no direct feedback from the game to the plant it can’t ‘learn’ as such) I was able to get it to play Soul Caliber VI, a player vs player fighting game, albeit really badly. It is akin to someone pressing buttons on the controller really rapidly and seemingly at random (a tactic I have too often been accused of abusing…).
Here is a short clip of it fighting in the arcade game mode.
I found some really bizarre outcomes through doing this and because I recorded vast amounts of midi data (on Ableton live) doing these tests I was able to view clear patterns after multiple days. For instance, the plant preferred vertical attacks earlier on in the day and horizontal attacks in the afternoon & evening. An increase in movement/strafing depending on the amount of light in the space. As well as this the frequency of signals being output from the plant would fluctuate based on a variety of elements such as time of day, if I was in the room or not, whether there were other plants that were nearby, and even if those plants were of a similar genus (it seemed to enjoy having ‘friends’ so to speak).
I took the plant online to fight other online players (without telling them they were against a plant) and it lost nearly every single fight ( I pity the people who lost against it). Initially, I thought it (the plant) was ‘bad’ at playing this particular game and tried to find others for it to enjoy, then I realised there should be no ‘bad’ way to play a game, only bad games. Which is exactly when I decided to make a game specifically for this house plant.
It was very difficult for me to imagine what kind of game a plant would want to play as we have no concept of plants playing, furthermore, anything I imagine to be fun or enjoyable is from the perspective of a bipedal human and not that of a house plant so would be inherently wrong.
I posited that if I were motionless and rooted to the same spot for my entire existence that I would dream of being able to move around, just as we, confined by gravity, dream of flying. So that was a start…
Then I began thinking about how I would represent such an entity, how a plant would visualise itself and also perceive the world around it. What would it see? How would it relate to its environment?