Surveillance Design Final Project
Process & Concept
When you read a book that is full of imagery words, What ís going on inside your mind? What images do you have in your head when you reading?
Here is my project entitled “Mapping the Imagination.”
So, my project can be translated as “A Visual Practice of Human Imagination and Image Recognition from Text Redaction with Photo Data on Google Search.” So, this is my zine. For me, it was a really meaningful experience making a zine by my hand. It was almost first analog design project after DT and so much fun.
Along with the question that the machine can really recognize the images based on human imagination, I have been particularly interested in these areas of Human Imagination, Cognitive Psychology, Photo Vis,Computer Image Recognition Technology, Artificial Intelligence, Linguistics. So, this project was also an experiment to explore the realm of human cognition and artificial image recognition.
Inspired by some zines that Melanie showed us in the class, in terms of the design process and the overall concept, I did the similar way of text redaction.
As you can see, I cut each word in the text out in square boxes and there are two kinds of colored lines of blue and pink. The texts are from a famous fiction written by Marcel Proust – “In Search of Lost Time.”
Swan’s Way – Chapter 1 – In Search of Lost Time
The reason I chose this text for redacting is this fiction is well known as the most imaginative literature that is full of sensibility in human history, and this is one of my favorite fiction.
One thing that is also critical for this project is the process to search for photo data on Google.
As you know, there are a massive amount of big data including photo data, and the algorithm of image recognition by computer is unprecedentedly evolving based on those data.
but as you can see, in the process of choosing Images that match with words is based on human imagination and it’s an arbitral process.
So in my opinion, even though the computer can recognize text and match with the photo quickly, there is still a room for human imagination that affects the choice in visual search. Through this visual practice, I wanted to illuminate the fact that human visual system and imagination is still a rich source of information. And modern surveillance system cannot invade a person’s mental privacy yet because the cognitive processes of individuals are based on each person’s unique experience in the life and creative imagination even though the artificial intelligence like Google “Alphago” are evolving and even developing the creative process on its own.
After the final presentation, I really wanted to develop this project more by figuring out the correlations between the words and my cognition process of choosing those images.
So, for the further development, I made a diagram in a form of the semantic neural network with D3.js and JSON data to clearly visualize the invisible cognitive process of the arbitral image choice of mine and to figure the correlation between the words that I chose out. The chunking of words was exactly representing the images that I chose. So, It reveals the fact that the choice of images is not just a randomize, quick choice but a sophisticated cognitive process of human image recognition.
(below) JSON dataset that I reversely extract words from images.
Many studies in Machine learning and Artificial Intelligence are trying to extract visual classifiers from the human visual system. There is a field of Artificial imagination (AIm), also called Synthetic imagination or machine imagination which is defined as the artificial simulation of human imagination by general or special purpose computers or artificial neural networks.