The project consists of an interactive data visualization that enables the detection of patterns of Tokyo cultural representation on Instagram. By a system of crawling data from the web, a database of 40,851 images was obtained. The system collects photos shared on Instagram that have labeled Tokyo by hashtags in 47 different languages. An Image Caption Generation model (Vinyals, Toshev, Bengio, & Erhan, 2016) was applied to those photos. From the resulting descriptions, the main “motifs” (words with the highest semantic content) were obtained using Natural Language Processing (Bird & Loper, 2004). When a viewer interacts with the installation, the work displays the images with the most recurring motifs in each of the languages, the descriptions, and the hashtags associated with the images.
References
Title: The unveiled city
Año: 2018-2019
Technique: Interactive data visualization. PC, TV (58”, 4K), webcam, mechanical arm, custom table (wood and pipes), printed graphic (framed).
Dimensions: Variable, minimum: 3m x 2m
Edition: 2 + 2PA. There is a unreleased high scale version of the project.
Shows:
Direction y concept: Yonlay Cabrera
Implementation advisor: Luis Diago
Programming: Gustavo Viera, Antonio Serrano
Production: Tama Art University Graduate School, Information Design Department; Meiji Institute for Advanced Study of Mathematical Science (MIMS).