[PT] Lev Manovich – Computer Vision

I presented a summary of reading of Lev Manovich’s book: Modern Surveillance Machines:  Perspective, Radar, 3-D Computer Graphics and Computer Vision in Surveillance Design classes. I was really excited presenting about Lev Manovich whom I’ve admired.

Lev Manovich – Modern Surveillance Machines:  Perspective, Radar, 3-D Computer Graphics and Computer Vision


[Surveillance Design] Mapping the Imagination

Surveillance Design Final Project

Final Zine


Process & Concept

When you read a book that is full of imagery words, What ís going on inside your mind? What images do you have in your head when you reading?

Here is my project entitled “Mapping the Imagination.”


Screen Shot 2016-05-12 at 3.03.32 PM

So, my project can be translated as “A Visual Practice of Human Imagination and Image Recognition from Text Redaction with Photo Data on Google Search.” So, this is my zine. For me, it was a really meaningful experience making a zine by my hand. It was almost first analog design project after DT and so much fun.

Along with the question that the machine can really recognize the images based on human imagination, I have been particularly interested in these areas of Human Imagination, Cognitive Psychology, Photo Vis,Computer Image Recognition Technology, Artificial Intelligence, Linguistics. So, this project was also an experiment to explore the realm of human cognition and artificial image recognition.

Inspired by some zines that Melanie showed us in the class, in terms of the design process and the overall concept, I did the similar way of text redaction.

IMG_4032 IMG_4021 IMG_4036 IMG_4024


Screen Shot 2016-05-12 at 2.52.23 PM

As you can see, I cut each word in the text out in square boxes and there are two kinds of colored lines of blue and pink. The texts are from a famous fiction written by Marcel Proust – “In Search of Lost Time.”

Screen Shot 2016-05-12 at 2.54.45 PM

Swan’s Way – Chapter 1 – In Search of Lost Time

The reason I chose this text for redacting is this fiction is well known as the most imaginative literature that is full of sensibility in human history, and this is one of my favorite fiction.

Screen Shot 2016-05-12 at 2.43.29 PM

 One thing that is also critical for this project is the process to search for photo data on Google.

Screen Shot 2016-05-12 at 2.59.01 PM

As you know, there are a massive amount of big data including photo data, and the algorithm of image recognition by computer is unprecedentedly evolving based on those data.

but as you can see, in the process of choosing Images that match with words is based on human imagination and it’s an arbitral process.

So in my opinion, even though the computer can recognize text and match with the photo quickly, there is still a room for human imagination that affects the choice in visual search. Through this visual practice, I wanted to illuminate the fact that human visual system and imagination is still a rich source of information. And modern surveillance system cannot invade a person’s mental privacy yet because the cognitive processes of individuals are based on each person’s unique experience in the life and creative imagination even though the artificial intelligence like Google “Alphago” are evolving and even developing the creative process on its own.

After the final presentation, I really wanted to develop this project more by figuring out the correlations between the words and my cognition process of choosing those images.

Screen Shot 2016-05-12 at 3.00.27 PM

Screen Shot 2016-05-12 at 2.44.22 PM

So, for the further development, I made a diagram in a form of the semantic neural network with D3.js and JSON data to clearly visualize the invisible cognitive process of the arbitral image choice of mine and to figure the correlation between the words that I chose out. The chunking of words was exactly representing the images that I chose. So, It reveals the fact that the choice of images is not just a randomize, quick choice but a sophisticated cognitive process of human image recognition.

(below) JSON dataset that I reversely extract words from images.

Screen Shot 2016-05-12 at 3.06.40 PM

Many studies in Machine learning and Artificial Intelligence are trying to extract visual classifiers from the human visual system. There is a field of Artificial imagination (AIm), also called Synthetic imagination or machine imagination which is defined as the artificial simulation of human imagination by general or special purpose computers or artificial neural networks.

Final Zine

Screen Shot 2016-05-12 at 3.04.23 PM

[Large System_Final Project] Real Time Data Visualization with Plotly and Arduino

I wanted to visualize physical data in real time, this was a goal in Large System class.

Arduino + Plotly Data Visualization – a real time data visualization of Arduino humidity detector.



Screen Shot 2016-05-10 at 8.22.24 PM.pngScreen Shot 2016-05-10 at 9.35.58 PM.png

Your Quantified Body, Your Quantified Self

Your Quantified Body, Your Quantified Self



Related to one of my final project concepts of self-tracking or self-surveillance (and also in the same domain with project 1 – 2), I found an interesting radio program that changes my viewpoint towards self-tracking via wearable devices for quantifying our daily life. This episode criticizes the rising culture of self-tracking in line with quantified self by highlighting many cases that a high level of awareness of daily life induces anxiety in some ways, even makes people feel like they are in prison. This discourse made me raise new questions: How safe are the self-tracking devices and app? How safe is your quantified self?

On this week’s episode, you’ll hear from Natasha Dow Schull, author of a forthcoming book called “Keeping Track,” and technology writer/early self-tracker and writer Paul Ford. Schull’s research has involved spending quite a bit of time in the aisles of Best Buy, listening in on the hopeful, aspirational purchases. However – as new research begins to bear out – respondents in the long run tend to fall in two camps: people who get turned off by the idea of self-tracking and need to be convinced of its value, or those who like the idea but want better technology. In both cases, the stalwarts of this billion-dollar industry are listening very, very closely to figure out what consumers really want from this trend.

We’re curious too, though for different reasons. We’ve spent the last few months asking a whole lot of people to speak to their experiences of quantifying themselves using technology. We wanted the story you can’t tell from the big tech conferences or even hanging out in the aisles of Best Buy. So we asked our audience to weigh in (figuratively, of course) on what makes for “useful” health technology – what different sorts of health hacking have really done to their health.