[PT] Lev Manovich – Computer Vision

I presented a summary of reading of Lev Manovich’s book: Modern Surveillance Machines:  Perspective, Radar, 3-D Computer Graphics and Computer Vision in Surveillance Design classes. I was really excited presenting about Lev Manovich whom I’ve admired.

Lev Manovich – Modern Surveillance Machines:  Perspective, Radar, 3-D Computer Graphics and Computer Vision


[Surveillance Design] Mapping the Imagination

Surveillance Design Final Project

Final Zine


Process & Concept

When you read a book that is full of imagery words, What ís going on inside your mind? What images do you have in your head when you reading?

Here is my project entitled “Mapping the Imagination.”


Screen Shot 2016-05-12 at 3.03.32 PM

So, my project can be translated as “A Visual Practice of Human Imagination and Image Recognition from Text Redaction with Photo Data on Google Search.” So, this is my zine. For me, it was a really meaningful experience making a zine by my hand. It was almost first analog design project after DT and so much fun.

Along with the question that the machine can really recognize the images based on human imagination, I have been particularly interested in these areas of Human Imagination, Cognitive Psychology, Photo Vis,Computer Image Recognition Technology, Artificial Intelligence, Linguistics. So, this project was also an experiment to explore the realm of human cognition and artificial image recognition.

Inspired by some zines that Melanie showed us in the class, in terms of the design process and the overall concept, I did the similar way of text redaction.

IMG_4032 IMG_4021 IMG_4036 IMG_4024


Screen Shot 2016-05-12 at 2.52.23 PM

As you can see, I cut each word in the text out in square boxes and there are two kinds of colored lines of blue and pink. The texts are from a famous fiction written by Marcel Proust – “In Search of Lost Time.”

Screen Shot 2016-05-12 at 2.54.45 PM

Swan’s Way – Chapter 1 – In Search of Lost Time

The reason I chose this text for redacting is this fiction is well known as the most imaginative literature that is full of sensibility in human history, and this is one of my favorite fiction.

Screen Shot 2016-05-12 at 2.43.29 PM

 One thing that is also critical for this project is the process to search for photo data on Google.

Screen Shot 2016-05-12 at 2.59.01 PM

As you know, there are a massive amount of big data including photo data, and the algorithm of image recognition by computer is unprecedentedly evolving based on those data.

but as you can see, in the process of choosing Images that match with words is based on human imagination and it’s an arbitral process.

So in my opinion, even though the computer can recognize text and match with the photo quickly, there is still a room for human imagination that affects the choice in visual search. Through this visual practice, I wanted to illuminate the fact that human visual system and imagination is still a rich source of information. And modern surveillance system cannot invade a person’s mental privacy yet because the cognitive processes of individuals are based on each person’s unique experience in the life and creative imagination even though the artificial intelligence like Google “Alphago” are evolving and even developing the creative process on its own.

After the final presentation, I really wanted to develop this project more by figuring out the correlations between the words and my cognition process of choosing those images.

Screen Shot 2016-05-12 at 3.00.27 PM

Screen Shot 2016-05-12 at 2.44.22 PM

So, for the further development, I made a diagram in a form of the semantic neural network with D3.js and JSON data to clearly visualize the invisible cognitive process of the arbitral image choice of mine and to figure the correlation between the words that I chose out. The chunking of words was exactly representing the images that I chose. So, It reveals the fact that the choice of images is not just a randomize, quick choice but a sophisticated cognitive process of human image recognition.

(below) JSON dataset that I reversely extract words from images.

Screen Shot 2016-05-12 at 3.06.40 PM

Many studies in Machine learning and Artificial Intelligence are trying to extract visual classifiers from the human visual system. There is a field of Artificial imagination (AIm), also called Synthetic imagination or machine imagination which is defined as the artificial simulation of human imagination by general or special purpose computers or artificial neural networks.

Final Zine

Screen Shot 2016-05-12 at 3.04.23 PM

Your Quantified Body, Your Quantified Self

Your Quantified Body, Your Quantified Self



Related to one of my final project concepts of self-tracking or self-surveillance (and also in the same domain with project 1 – 2), I found an interesting radio program that changes my viewpoint towards self-tracking via wearable devices for quantifying our daily life. This episode criticizes the rising culture of self-tracking in line with quantified self by highlighting many cases that a high level of awareness of daily life induces anxiety in some ways, even makes people feel like they are in prison. This discourse made me raise new questions: How safe are the self-tracking devices and app? How safe is your quantified self?

On this week’s episode, you’ll hear from Natasha Dow Schull, author of a forthcoming book called “Keeping Track,” and technology writer/early self-tracker and writer Paul Ford. Schull’s research has involved spending quite a bit of time in the aisles of Best Buy, listening in on the hopeful, aspirational purchases. However – as new research begins to bear out – respondents in the long run tend to fall in two camps: people who get turned off by the idea of self-tracking and need to be convinced of its value, or those who like the idea but want better technology. In both cases, the stalwarts of this billion-dollar industry are listening very, very closely to figure out what consumers really want from this trend.

We’re curious too, though for different reasons. We’ve spent the last few months asking a whole lot of people to speak to their experiences of quantifying themselves using technology. We wanted the story you can’t tell from the big tech conferences or even hanging out in the aisles of Best Buy. So we asked our audience to weigh in (figuratively, of course) on what makes for “useful” health technology – what different sorts of health hacking have really done to their health.

“Generation Like”

“Generation Like” is a documentary that shows the overall social media culture of teenagers today.

My undergrad major was PR & Advertisement, so I learned about new media marketing strategies and digital advertisement for cross-media platforms.




The documentary showed me the currents of the way the teens interact with the market by participating on social media.

By clicking the “Like” button and participating their favorite brands and entertainment’s campaign, they are not just being marketed but also being a part of marketing itself.


Also, the companies that provides marketing insights for their clients by using analysis tool for social media marketing are running the show. So the numerous numbers of “Like” by young users are dissected, analyzed and monetized in real time and advertisements companies are using the data.

Screen Shot 2016-03-01 at 1.00.52 PMScreen Shot 2016-03-01 at 1.00.46 PMScreen Shot 2016-03-01 at 12.59.58 PMScreen Shot 2016-03-01 at 12.59.46 PM


Related Article

Mark Zuckerberg says the age of privacy is over.







개인정보를 연결하는 행위를 앵커링(Anchoring)이라고 한다. 사람이 움직이는 모든 것에서 정보가 발생한다. 지하철, 버스, 거리 CCTV, 차량용 블랙박스, 신용카드 결제, 네이버 및 구글 검색 및 조회 등 보고, 타고, 쓰고, 이용하는 모든 것들이 정보가 되어 하나씩 쌓이고 있다. 지금시대는 바로 개인과 관련된 모든 정보가 수집되고 쌓이는 빅데이터 시대인 것이다. 앵커링은 이질적인 정보를 갖고 한 사람을 파악하는 일 또는 특정 정보를 연결시켜 특정인의 정보를 파악하는 것을 의미한다. 빅데이터 수집이나 분석을 반대하는 사람들은 바로 이 앵커링을 통한 개인정보 침해를 이유로 들고 있다.

에드워드 스노든은 ‘사회가 발전하면서 프라이버시에 대한 관점도 변화하고 있다. 외부의 간섭이나 침해로부터 벗어나 자유롭게 혼자 있을 수 있는 권리가 고전적 관점에서 프라이버시의 정의였다면, 요즈음처럼 정보기술이 발달하고 많은 사람들이 어울려 복잡한 관계를 만들어가는 현대사회에서는 오히려 개인정보에 대한 자기 결정권의 관점에서 보는 편이 더욱 맞는 정의’일 것이라고 말한다

[Surveillance Design] Invasive Looking Prototype


Surveillance Design Week 4 – Invasive Looking Prototyping

For the concept of invasive looking, I would suggest a new desktop dashboard UI that shows our daily life data gathered by mobile devices and social networks.

Nowadays, everything is connected with our online identification and all the devices and social networks are gathering the daily data and activities in every seconds in case they can access to my account.

So, I imagine a dashboard that collects all the daily data and analyze them with algorithms and then visualize the data in a creative way to let us know the daily pattern at a glance.

To make a visual example of the dashboard, I gathered my actual daily data by a health tracking app, my scheduler and other social networks and then manipulated the data in Excel and Rstudio.


The prototype is a bit crude now, but I plan to develop this for a better version by finding some hidden patterns with the daily data that I’ve gathered. Also, I want to make an interactive version of it to connect those data in real time by using API and social network widgets.


Screen Shot 2016-02-23 at 7.27.26 PM

For the context of surveillance design, It would be a surveillance system that is a kind of self-monitoring and self-regulation. The system can give some recommendations for an individual’s life based on the data. Also, by using those metadata, companies and social network services can figure a person’s hidden needs and behavioral pattern by analyzing the connectivity between each daily activity of an individual.

[Week 2_Homework] Surveillance

Read: Christian Parenti’s “Life in the Glass Box,” intro to The Soft Cage, 2003
Design: students bring visual / textual examples based on prompt “control from above”
wk 03, Feb 09: Surveillance Inc.
In class
Discuss: Parenti reading, student examples
Brief: assignment #1, paper prototype re Invasive Viewing, concept next wk, pinup on March 1st (what is pinup?)
Read: Jean-Pierre Barou interview with Foucault The Eye of Power, on Panopticism (many seen by few)
Design: develop concept for Invasive Viewing project to present in class next week.
Screen Shot 2016-02-09 at 3.38.24 PM
I personally experienced in surveillance from above very recently.

Because I’m living in the school dorm, there are always CCTVs that are capturing my movement in the building. 2 days ago, I lost my backpack in the basement and I asked the dorm security guards for checking the recorded video to look into what was happening at that time. I stayed all night in the basement at that time, so I watched the surveillance video that took my every movement in the space from 11 pm at night to 8 am in the morning. It was such a shocking experience to realize the school is observing me all the time. Unfortunately, I couldn’t find my backpack, but It was thought-provoking experience of surveillance system within the public space.



Surveillance Design that I created before

  • Kids Behavior counting machine that can be surveilled by parents