Vision and Automation in a post-Covid World (Journal of Visual Culture & HaFI, 42)

This is the forty-second instalment of a collaborative effort by the Journal of Visual Culture and the Harun Farocki Institut, initiated by the COVID-19 crisis. The call sent to JVC’s editorial board, and a wide selection of previous contributors and members of its extended communities, described the task as follows: “There is a lot of spontaneous, ad hoc opinion-making and premature commentary around, as to be expected. However, the ethics and politics of artistic and theoretical practice to be pursued in this situation should oblige us to stay cautious and to intervene with care in the discussion. As one of JVC’s editors, Brooke Belisle, explains: ‘We are not looking for sensationalism, but rather, moments of reflection that: make connections between what’s happening now and the larger intellectual contexts that our readership shares; offer small ways to be reflective and to draw on tools we have and things we know instead of just feeling numb and overwhelmed; help serve as intellectual community for one another while we are isolated; support the work of being thoughtful and trying to find/make meaning…which is always a collective endeavour, even if we are forced to be apart.'” TH


Image from Common Objects in Context (COCO) image dataset used to train computer vision systems


Vision and Automation in a post-Covid World

By Joel McKim


The Guardian headline reading “Robots to be used in UK care homes to help reduce loneliness” is accompanied by a photo of a gleeful senior citizen interacting with a wheeled semi-humanoid robot named Pepper. The article describes a research trial studying the use of “culturally competent” robots to assist in caring for the elderly in the UK and Japan and although the project actually began several years ago, it’s only now, post-onset of Covid, that the story has found journalistic attention. The image of AI-powered robots offering a possible solution to the financial difficulties, health concerns and staff burnout facing the care industry, is one seemingly designed to elicit equal parts anxiety and condemnation.

But the role automation will play in our post-Covid world is likely to be less spectacular, yet more disruptive than such contentious visions of robotic health facilities. And while we may balk at AI replacing the forms of care and intimacy we view as innately human, there are already indications that the current crisis is making many of us increasingly amenable to other forms of more mundane automation. The move towards cashier-less retailers and automated warehouses that perhaps caused some unease in the past, may now appear as a sensible and even ethical solution. A debate about mass unemployment and increased corporate profits is quickly reframed into one about responsible health decisions and employee safety. As the human-computer interaction researcher Richard Pak asserts in a New York Times article on this very subject, “Pre-pandemic, people might have thought we were automating too much. This event is going to push people to think what more should be automated.”[i] For those with much to gain from greater levels of work-place automation, this would seem an opportunity to seize upon a moment of increased public receptivity.

If we’re to trust the investment reports, business magazines and policy think tank whitepapers on the topic, post-pandemic interest in automation is already surging. To take one circulating, but not-entirely disinterested example, the Honeywell Intelligrated Automation Investment Study found that since the onset of Covid over half of US businesses are increasingly open to investment in automation with e-commerce; grocery, food and beverage; and logistics companies chief among them. But on the topic of labour impact, these sources tend to offer either platitudes – “The vulnerable will be the most vulnerable” (Brookings Institute)[ii], or hollow reassurances – “People empowered by automation will bring us out of this crisis” (Forbes).[iii]

A flurry of more sustained academic considerations of the potential impact of AI and automation have emerged over recent years, all cautionary but with various levels of optimism or pessimism regarding how humans will fare in the automated world to come – books like Erik Brynjolfsson and Andrew McAfee’s The Second Machine Age: Work, Progress, and Prosperity in a Time of Brilliant Technologies and Carl Benedikt Frey’s The Technology Trap: Capital, Labor, and Power in the Age of Automation. Frey’s 2013 research with Michael Osborne at the Oxford Martin School, published as “The Future of Employment: How Susceptible Are Jobs to Computerization,”[iv] was an early and influential warning of just how cataclysmically disruptive processes of automation may be for the current labour force. Analyzing O∗NET, an online detailed description of occupations developed for the US Department of Labor, Frey and Osborne determined that 47 percent of US employment falls in the high-risk category of being automated within the next decade or two. Frey has also acknowledged the potential of the Covid-crisis to acerbate an already troubling situation, writing in the Financial Times, “automation anxiety looks set to witness a revival – and with good reason. Coronavirus is likely to accelerate automation.”[v]

Why does this admittedly disheartening discussion of automation and work precarity belong in a series reflecting on Covid visual culture? Recent advances in computer vision technology (enabled by machine learning and deep neural networks) are one of the primary factors driving forms of automation that importantly span both the manufacturing and service economy, from driverless vehicles, to assembly line robotics, to checkout free shops. One indication of this development, image recognition error rates for neural networks have fallen precipitously in recent years, with computer vision algorithms now able to classify images in large datasets like ImageNet with as much as 98% accuracy.[vi] Our powers of perception – once, like caring, a seemingly innately human capacity resistant to machine replication – are apparently no longer the insurmountable barrier to automation we might have believed. Much of this technology has moved beyond mere speculation and into a prototyping phase, and of course some forms of workplace automation, like warehouse robotics, are already with us. The drone delivery systems and autonomous shipping vehicles, envisioned by companies like Amazon are still unproven, but the underlying computer vision systems they rely upon are developing quickly and a Covid investment push may well bring forward their timetable of deployment. In an economy increasingly reliant on now vulnerable service sector jobs, like transportation and retail, this could have a devastating impact.

These concerns regarding the relationship between human and computational vison were of course central to Harun Farocki’s own prescient investigations of machine vision and operational images, from military tracking systems to computer simulations. Today, artists like Heather Dewey-Hagborg and Adam Harvey, are producing work that compels us to think critically about our contemporary technologies of artificial perception, exposing the technical and social infrastructures that underpin facial recognition systems, for example. These artists help shed light on an already unfolding regime of vision and automation, one potentially accelerated in our post-Covid world.

Joel McKim is Senior Lecturer in Digital Media and Culture and the Director of the Vasari Research Centre for Art and Technology at Birkbeck, University of London. He was recently a visiting fellow at the V&A Museum researching “A Pre-history of Machine Vision.”
September 17th, 2020 — Rosa Mercedes / 02

The Reconstruction of Ukraine. Ruination / Representation / Solidarity, online symposium, September 9-11, 2022. “The Reconstruction of Ukraine: Ruination / Representation / Solidarity” devotes particular attention to cities, architecture, art, culture and psychological trauma – but the scope of the conversations it aims to start is broader. In due course, the discussions held during the symposium may coalesce into myriad projects, initiatives and experiments undertaken by government institutions, municipalities, educational and cultural bodies and other more interstitial actors. The ambition of this symposium is to establish a platform for dialogue, facilitating communication, collaboration and constructive argument between diverse actors and initiatives.

George Edwards (Zetkin Collective) on war, nationalism and the “anti-climate lobby” (via Arts of the Working Class): “The latest prognosis of this particular war was spelt out in a flurry of reports from the IPCC; the most recent, described as ‘an atlas of human suffering’ by the chief of the UN, demanded ‘rapid, deep and immediate’ emissions cuts in all sectors to ensure an inhabitable planet for all. In step with the science, many wish this conflict to mark the beginning of an intensified programme of decarbonization, ridding economies of not only Russian, but all fossil fuels, wherever their geological source. But whilst political leaders scramble abroad to secure new sources of fossil fuels – sweet-talking sheiks and summoning LNG terminals from the ground – a resourceful and committed cohort, let’s call them the anti-climate lobby, refuse to accept this diagnosis. The partakers in the fossil industry have seized upon this crisis, sensing it as an opportunity to enlarge and entrench economic interests rooted in fossil fuels. As the course of action prescribed by the IPCC imperils this line of business, the attempts to secure fresh investments in fossil fuel infrastructures, to lock-in production and secure profits for the coming decades may feel all the more pressing. The solutions they pose also fit within the national frame and it is with nationalist political forces that they find their most ardent allies.”

July 31st, 2022

The fundamental difference that we face in Europe at the moment between the Western approach characterized by the pursuit of peace and the Eastern one focused on liberation and independence poses a dramatic challenge – in order to survive and progress, democracy as a political regime has to be capable of defending itself also in a military way.” Armed Democracy revolves around the concepts of imperialism, liberation, fascism, autocracy, revolution, and militarization in pursuit of the world to come on Europe’s burnt out land. Conceived by the Kyiv Biennial and Biennale Warszawa from the East Europe Biennial Alliance, this special public program, curated by Vasyl Cherepanyn within the 2nd edition of Biennale Warszawa, the program is a first part of the series organized by the East Europe Biennial Alliance discussing Russia’s military invasion of Ukraine and taking place in Warsaw, Prague, Kassel, and Riga over the summer and fall of 2022.

Olena Lyubchenko on Whiteness, Expropriation, War, and Social Reproduction in Ukraine (via LeftEast): “[…] when we hear on the news that ‘Ukraine is fighting a European war’ and ‘Ukraine is defending Europe’, amid images of fleeing ‘poor white’ women with children prioritized over racialized ‘Others’, ‘Ukraine’ is being made ‘white’ in the global imaginary. That is, “the injunction to ‘return to Europe’ by way of Europeanization is enabled and conditioned on the mythologies of Western civilization, and that Europeanization at once marks (promulgates) and unmarks (naturalizes) racial whiteness” [Nadezhda Husakouskaya and Randi Gressgård]. The paradox is that Europe’s existence as such has only been possible precisely because of the exploitation of global working peoples through expropriation of resources and today neoliberal economic reforms and reproduced by feminized labour.”

Vasyl Cherepanyn about the “inertness, hiding behind the European Wall” (via L’Internationale): “Many Western institutions that have been claiming ‘radical political engagement’ for years, have simply resorted to a white cube radicalism and self-satisfying humanitarianism, too afraid of acting politically beyond their comfort zone and unsettling their publics and authorities by attempting to affect the decision-making process regarding the Ukrainian cause.”

May 28th, 2022

Tatsiana Shchurko on the War in Ukraine, Entangled Imperialisms, and Transnational Feminist Solidarity, via LeftEast (May 2, 2022): “[An] uneven knowledge production and the many implications of the war against Ukraine reveal the dire need to develop a feminist anti-capitalist critique of multiple imperialisms. This language should grow from within the occupied and suppressed communities of Eastern Europe and Eurasia. An anti-imperialist and anti-capitalist feminist positionality grasps that the local is part of a global in an effort to build transnational connections of mutual aid and support against state and corporate violence. For example, statements of solidarity with Ukraine expressed by the International Committee of Indigenous Peoples of Russia and Native American communities along with the anti-war feminist march in Bishkek (Kyrgyzstan) on March 8, 2022, pointing out that the war in Ukraine should be of concern for a broad transnational community, may serve as instrumental examples of alternative anti-capitalist and anti-imperialist solidarities that stretch beyond state regulations and macro-politics and foreground decolonial perspectives, necessary in addressing entanglements of multiple imperialisms. Such solidarities also bring to light hidden interconnections of the past that allowed for distant communities to survive and support each other against the violence of imperialist intervention and its attendant capitalist exploitation. Thus, the march in Bishkek reminds of the socialist roots of the International Women’s Day to call for internationalist, intersectional, class solidarity against imperialism and militarism.”

Vasyl Cherepanyn on that “It’ll take more than tanks to ease Germany’s guilt” (via Politico): “Since the Soviet Union’s collapse, Germany has been imposing neocolonial optics on its Eastern European ‘peripheries,’ and on the post-Soviet space in particular, where Ukraine was long considered a gray buffer zone about which the EU was ‘deeply concerned.’ Germany didn’t bother itself much with differentiating between former Soviet countries’ pasts. Even until recently, any Ukrainian agenda in Germany was often ‘balanced’ with a Russian perspective, so as to not exclude the latter by any means.”

An unnamed anarchist and art scholar, who joined the Territorial Defense Forces, quoted by Olexii Kuchanskyi in an essay on “Digital Leviathan and His Nuclear Tail” (via Your Art and e-flux notes): “At dawn, Dima and I talked about cinema. Dima believes that cinema is inferior to literature as a means of expression because you spend much more time with a book than a film. It’s a really interesting point, something to dig into. I studied at the department of art theory & history and I never thought of it. Dima served in the military after school and worked at the factory all his life. He listens to rap, smokes pot, and tries to have fun. He is thirty-eight, his child was born last year. He likes Wong Kar-wai and is a fan of Asian cinema in general. Dima communicates by quoting Omar Khayyam, Confucius, and other awesome guys.”

April 20th, 2022
moreless news