Fieldworking the art science of AI with the Institute of Media Archaeology

How can we exhibit and expose the puzzling concerns of AI technologies to the public when AI is already such an everyday thing for many, yet also a deeply abstract “thing” that looks out at the world through a chatbot window? If a wide range of people are thinking about AI nowadays, some have more experience than others in tackling it as a shift in the media landscape. Yet these very same people are also challenged in their usual working process. For the Institute of Media Archaeology, a collective of artists led by Elisabeth Schimana for twenty years, working through ideas and media practices is best done through the making of exhibitions. With the workshop “whitebox ai”, the extended collective embarked on three days of conversations, in the company of curators from three museums (in Vienna, Graz, and St Pölten). Invited by my wonderful colleague Avital Meshi, a media artist and researcher at UC Davis, I had the chance to wrap up some of my most recent ethnographic experiments and reflections on chatbots and AI in science during a lovely retreat in the Lower Austrian Pre-Alps. As an ethnographer of art practices and a multimodal anthropologist of technologies, I took a ride with that wonderful bunch — fieldworking on the hospitable shoulders of friendly giants, and contributing to the communal soup of ideas and propositions.

Live drawing by Maxime Le Calvé: whitebox ai participants around a long table with laptops and a flipchart schedule, Neuhauser Kunstmühle, Hohenberg

Can AI be considered a medium at all? If one takes it as a vehicle and a substrate for communication and thinking, yes, absolutely. And if it is to be taken as a milieu, even more so. The conversation around the massive and sensitively lacquered dinner table on the third floor of an artist house dedicated to printing in its many forms left a deep impression. I hope my coffee mug didn’t leave a mark on the table. But not much coffee was needed, because the discussion followed a halting rhythm, a breakbeat of technical, political and social aspects, entangled with the very facts about the AI industry that we were — and still are — shaping into an event that will reach a wide audience.

What I loved about the workshop was how the space was held by the IMA core team (Elisabeth, Seppo Gründler, Philip “Pi” Leitner and Andrea Sodomka), and how they made it so lively. Elisabeth lives in the next village, and she sourced the best food and cooked for us personally. Curating both the conversations and the menu, she had a sharp eye for making sure that everyone would contribute in one way or another, not only with words but also with their hands.

Live drawing: Institute of Media Archaeology participants cooking together and sharing pear wine at the first-evening dinner, Hohenberg, 23 September 2026

People! For Elisabeth and the core team, the exhibition should not have screens; it should be a place where visitors participate in installations and performances. Not pedagogical, but also not thoroughly political — or at least not in the worn-out repetition of anti-capitalist leitmotifs. How can we expose, in new and interesting ways, the hellish kitchen of AI corporations? How can we translate some of the hope invested in these technologies into something that could help our societies?

While the conversations kept coming back to the critical thinking that many of us believed the exhibition should deliver, the collaboration between Pi and Kilian Jörg brought this dimension in an elegant yet militant way. Thinking through Foucault is still a way to do some of the heavy lifting, but keeping it improvisational keeps it light on its feet and ready to dance with other propositions. Yes, we need to tackle the “data centre”, a physical, material point of discussion about resources and territory, which gives a concrete, earthly anchor to the debates, as Felix Stadler pointed out.

Live drawing: Kilian Jörg improvising on AI and capitalism in front of a screen reading “gouvernemental technique”
Live drawing: Avital Meshi presenting her GPTMe project from a laptop

Avital and I presented our work in a joint session on “object–subject” oscillation. Her work has been featured in anthropology journals, in particular her “Séance” performance, in which she channels GPT through a wearable device, calling out the names of the audience’s dead relatives and friends and speaking whatever GPT brings through her lips — giving rise to incredible moments of presence, which echo older devices for channelling spirits through technology.

The oscillation of the chatbot between object and subject led to similar fits of presence in my own experiments with tarot-inspired ethnographic devices. Calling out examples of stagings and tricks, I drew on the recent article by Rodrigo Ochigame and Graham M. Jones, “Toward a phenomenology of mystification: The ambivalence of magic among AI technologists”, on mystification within the AI community. I then pivoted to my current research on how to reroute puzzlement practices towards other practices, more conducive to understanding and closer to what fieldwork is all about. We need to become more aware of its texture and what it does to us — but how do we bring this to wider audiences in a package that engages their curiosity as well as their burning sense of sovereignty?

By late afternoon, the group decided to let things sit after an already long day. Some of us took a spontaneous hike up the neighbouring hill — I had the excellent company of Felix — just in time to be drenched by a sudden rain. Moments of companionship are only intensified by an unprompted soaking. I wished I had packed better shoes. And another pair of trousers.

Mixed-media drawing: RYBN’s matchbox tic-tac-toe learning machine, with players calling “Top left!” and “Punish your MENACE!”

After dinner, dried off, we gathered for the evening’s last activity: a “laborious computing” session by the French artist collective RYBN. Taking up “MENACE” a now classic hands-on demonstration of how machine learning works — played by a a pile of hundreds of matchboxes teaching itself to play tic-tac-toe — Kevin Bartoli and Marika Dermineur explained how making two of the devices play against each other had the interesting effect of removing all fun from the experience, reducing the operators to a dull series of manipulations that felt very much like the hand labour of manufacturing AI models from the perspective of its “Mechanical Turks”. (One of their chosen fieldsites is the Amazon-owned platform itself, where they take on and analyse the tasks on offer.) By rewarding or punishing the device, the machine does learn to play better. But pitting two of them against each other makes the experience random and meaningless.

Is this what AI could do to us? Some of the participants seemed to think so. But time and again during the retreat, the members of IMA looked for ways to “make” things with it, to relay tactics of resistance, and to reclaim some of the openness to uncertainty and creative refusal that “open source” can rhyme with.

Fieldwork in the art-science VR scene: Sophie Erlund & the Experimenting, Experiencing, Reflecting group @PSM Gallery

Yesterday at the PSM Gallery in Schöneberg (Berlin), Sophie Erlund was presenting half a day of workshop and presentations around her VR piece Nature is an event that never stops. She has been working on that piece for the last six months, and it will be on display until 25.02.2023. It’s fantastic, definitely worth a trip to this part of the city where a cluster of galleries is established, on the opposite side of the canal from the Neue Nationalgalerie.

The artwork is a collaboration with the EER group, a mixed bunch of scientists and artists interested in playful approaches to inquire into perception. They offer pathways between cognitive science and installation art, using a “French” method to conceive and evaluate these hybrid setups: microphenomenology. The cognitive scientist Katrin Heimann interviewed visitors and presented her first conclusions in the first part of the workshop in text-heavy slides. She invited us to close our eyes as she channeled the experiences “in first-person” that she had collected. In the second part, Karsten Olsen presented his work on “cultural transmission,” the cognitive mechanism that is explored in the piece by Sophie Erlund. How are sketches or colors transformed as they are memorized and transmitted?

Microphenomenology is the child of the philosopher Claire Petitmengin. The method is elaborating on a technique called the “elicitation interview” which was invented by Pierre Vermersch (1994) and further developed in collaboration with Nathalie Depraz and Francisco Varela as a “phenomenological practice” in the book On Becoming Aware: A pragmatics of experiencing (2003). It is a delicate practice, a deep dive of the interviewer and the interviewee into the sensations and thoughts that occurred during a targeted experience. Claire Petitmengin has conducted research in contemplative science for the last 30 years. The method she teaches indeed shares many principles with meditation, evolving self-inquiry into interpersonal approaches. The method came to me in a new light influenced by the work of EER member Joe Dumit: what if we took it as a contact improvisation exploration inside and around a phenomenon? That day, we centered the interpersonal perceptive field on the lived experience of unprepared visitors going through the VR “film” of Sophie Erlund.

The final panel featured the artists Sophie Erlund and Helene Nymann, the neuroscientist, poet, and brain activist Pireeni Sundaralingam, and the anthropologist and cognitive scientist Andreas Roepstorff. It was introduced by Helena Herzberg, the art manager of PSM Gallery. The session was touching on many topics ranging from cognitive flexibility in school kids to funding schemes for art-science endeavors. Excellent both in content and shape, this two-hour conversation strokes a powerful chord. The participants took the context of EER and the production of the VR piece as a start. The focus went quickly to the serious political implication of bringing together in playful ways the knowledge of cognitive neuroscience and that of artists. Challenged by the audience, speakers stated the urgency of encouraging resistance against the pervading rigidity of the educating system, as well as the uncertainty-adverse societal context. Staging and sharing more-than-human perceptions, as Erlund does so masterfully in her VR film, is one of the many ways to champion tender attention to other people's experiences. As the EER member and play scholar Amos Blanton puts it in the end: bringing children and adults into creative exercises brings up the fears of failing and coming short. Yet the moment when they become engaged in the aesthetic activity, these fears dissolve and the joy of tinkering takes over. Hearing these words, I lifted up my head from my iPad for a short moment, reflecting on graphic ethnography and my experience of teaching ethnography through drawing. So much food for thought today, and great insights on how to frame an art-science VR experience. The panel, as well as the other interventions of the day, were documented and will be available soon on https://www.eer.info/

All the info is on the website of the gallery.

Sharing my sketchy fieldnotes on the spot with anthropologist colleague Andreas Roepstorff w/ ©Yoonha Kim, exchanging first-person impressions in embodied way at the end of the day.

Conference-as-fieldwork: EASA 2022 in Belfast

So happy to be in Belfast for a dip into our fleshy community of scholars! Ethnographers can’t help it, they attend conferences ethnographically. Here is a graphic report.

The ethnographer at work.

Sitting in the corner that will offer the clearest picture is more often than not a deliberate choice.