Photo of researcher studying a response from Florence

Project Florence

A Plant to Human Experience

If plants could talk to us, what would they say? Equally important how might they respond to us if we could converse with them? How might these conversations evolve and expand our ability to better relate with the Natural World?

Project Florence is an artistic representation of a Plant-Human Interface Experience that is built on top of a scientific analysis of the plant and its environment. Paired with the ability to receive human input, the plant can return a response, thus promoting a two-way conversational experience. Combining biology, natural language research, design, and engineering… we have created an instantiation of a plant to human interface through the power of language. Project Florence enables people to converse with a plant by translating their text sentiment into a light frequency the plant can recognize and respond to.

Project Florence uses light frequencies to drive action within the plant

Using light frequencies to drive action within the plant

Silver/AgCl electrodes for measuring the cell membrane action potential

Silver/AgCl electrodes for measuring the cell membrane action potential

When you visit Project Florence, you begin by typing a message to it on a keyboard that is connected to the computer that is monitoring the plant ecosystem.  What you type is then analyzed by our Natural Language Processing components to examine the sentiment and the sentence structure, with the result then translated into stimuli (in this case: different light frequencies and duration) that the plant can understand and react to.  The resulting signals are used to modulate a light source that projects either a red or blue light spectrum based on that sentiment. For positive sentiment, we flash a red-light spectrum that encourages plant cells to grow. For negative, we project a blue-light that in effect turns off the cells ability to expand. We leverage the plant’s ability to respond to different light properties to deliver different sentiment and trigger a plant response.  Based on the “mood” of the plant (derived from the various sensors in the enclosure) and the content of the message from the visitor, a response is generated (again using the Natural Language Processing), and that message is printed and displayed.

Natural Language Algorithm used to determine sentiment and semantic content

Natural Language Algorithm used to determine sentiment and semantic content

The electrical signal generated by cell depolarization through ion fluxes

The electrical signal generated by cell depolarization through ion fluxes

The opportunity to interact and communicate with our natural environment enables us to look beyond the physical properties of plants and gives us access to look at the processes and functions of plants. Within the Florence ecosystem, there are various sensors measuring environmental factors that define Florence’s “mood”.  These sensors include soil moisture, air humidity, carbon monoxide, and air temperature. These sensor values are collected and streamed to the Azure Cloud service. The Azure service combines this plant-mood-affecting information with the Natural Language Processing of the human conversation as inputs into the formulation of Florence’s conversational response.

An 8-channel board for measuring bio-electrical signals

An 8-channel board for measuring bio-electrical signals

Plant response generated by signal translation

Plant response generated by signal translation

The ‘moods’ of Florence are defined by the common knowledge of plant physiology and its reaction to environmental conditions like weather, draught and its internal clock (circadian rhythm). The different conditions are than mapped on common human reactions to thirst or tiredness and to phrases and idioms used in farming and gardening. We also developed a set of tools to help us examine the reactions of plants to different light frequencies and durations as proposed in project Florence. These tools enabled us to measure variation potential changes within the plant by inserting needle electrodes.

Project Florence is an artistic interpretation of a future world where nature and humans can communicate and co-exist in greater harmony. Enabling people to “talk” to a plant and receive a response opens their minds to this concept. Sometimes, Florence can be quite cranky and unpleasant if she is too dry or does not care for your input. This too invokes a sense of personality to the plant that people would not normally consider. This could lead to novel applications for agriculture to detect things like plant infestation at an earlier stage, requiring less pesticides. This can also expand our ability to monitor our natural environment and crop-fields to better understand the problems we face and to build more sustainable agricultural systems.

Future opportunities:

  • Education/Research
  • Environmental monitoring
  • Gene expression
  • Interaction with natural environment
  • Studying adaptation of plants at different locations