Vision and Automation in a post-Covid World (Journal of Visual Culture & HaFI, 42)

This is the forty-second instalment of a collaborative effort by the Journal of Visual Culture and the Harun Farocki Institut, initiated by the COVID-19 crisis. The call sent to JVC’s editorial board, and a wide selection of previous contributors and members of its extended communities, described the task as follows: “There is a lot of spontaneous, ad hoc opinion-making and premature commentary around, as to be expected. However, the ethics and politics of artistic and theoretical practice to be pursued in this situation should oblige us to stay cautious and to intervene with care in the discussion. As one of JVC’s editors, Brooke Belisle, explains: ‘We are not looking for sensationalism, but rather, moments of reflection that: make connections between what’s happening now and the larger intellectual contexts that our readership shares; offer small ways to be reflective and to draw on tools we have and things we know instead of just feeling numb and overwhelmed; help serve as intellectual community for one another while we are isolated; support the work of being thoughtful and trying to find/make meaning…which is always a collective endeavour, even if we are forced to be apart.'” TH

 

Image from Common Objects in Context (COCO) image dataset used to train computer vision systems

 

Vision and Automation in a post-Covid World

By Joel McKim

 

The Guardian headline reading “Robots to be used in UK care homes to help reduce loneliness” is accompanied by a photo of a gleeful senior citizen interacting with a wheeled semi-humanoid robot named Pepper. The article describes a research trial studying the use of “culturally competent” robots to assist in caring for the elderly in the UK and Japan and although the project actually began several years ago, it’s only now, post-onset of Covid, that the story has found journalistic attention. The image of AI-powered robots offering a possible solution to the financial difficulties, health concerns and staff burnout facing the care industry, is one seemingly designed to elicit equal parts anxiety and condemnation.

But the role automation will play in our post-Covid world is likely to be less spectacular, yet more disruptive than such contentious visions of robotic health facilities. And while we may balk at AI replacing the forms of care and intimacy we view as innately human, there are already indications that the current crisis is making many of us increasingly amenable to other forms of more mundane automation. The move towards cashier-less retailers and automated warehouses that perhaps caused some unease in the past, may now appear as a sensible and even ethical solution. A debate about mass unemployment and increased corporate profits is quickly reframed into one about responsible health decisions and employee safety. As the human-computer interaction researcher Richard Pak asserts in a New York Times article on this very subject, “Pre-pandemic, people might have thought we were automating too much. This event is going to push people to think what more should be automated.”[i] For those with much to gain from greater levels of work-place automation, this would seem an opportunity to seize upon a moment of increased public receptivity.

If we’re to trust the investment reports, business magazines and policy think tank whitepapers on the topic, post-pandemic interest in automation is already surging. To take one circulating, but not-entirely disinterested example, the Honeywell Intelligrated Automation Investment Study found that since the onset of Covid over half of US businesses are increasingly open to investment in automation with e-commerce; grocery, food and beverage; and logistics companies chief among them. But on the topic of labour impact, these sources tend to offer either platitudes – “The vulnerable will be the most vulnerable” (Brookings Institute)[ii], or hollow reassurances – “People empowered by automation will bring us out of this crisis” (Forbes).[iii]

A flurry of more sustained academic considerations of the potential impact of AI and automation have emerged over recent years, all cautionary but with various levels of optimism or pessimism regarding how humans will fare in the automated world to come – books like Erik Brynjolfsson and Andrew McAfee’s The Second Machine Age: Work, Progress, and Prosperity in a Time of Brilliant Technologies and Carl Benedikt Frey’s The Technology Trap: Capital, Labor, and Power in the Age of Automation. Frey’s 2013 research with Michael Osborne at the Oxford Martin School, published as “The Future of Employment: How Susceptible Are Jobs to Computerization,”[iv] was an early and influential warning of just how cataclysmically disruptive processes of automation may be for the current labour force. Analyzing O∗NET, an online detailed description of occupations developed for the US Department of Labor, Frey and Osborne determined that 47 percent of US employment falls in the high-risk category of being automated within the next decade or two. Frey has also acknowledged the potential of the Covid-crisis to acerbate an already troubling situation, writing in the Financial Times, “automation anxiety looks set to witness a revival – and with good reason. Coronavirus is likely to accelerate automation.”[v]

Why does this admittedly disheartening discussion of automation and work precarity belong in a series reflecting on Covid visual culture? Recent advances in computer vision technology (enabled by machine learning and deep neural networks) are one of the primary factors driving forms of automation that importantly span both the manufacturing and service economy, from driverless vehicles, to assembly line robotics, to checkout free shops. One indication of this development, image recognition error rates for neural networks have fallen precipitously in recent years, with computer vision algorithms now able to classify images in large datasets like ImageNet with as much as 98% accuracy.[vi] Our powers of perception – once, like caring, a seemingly innately human capacity resistant to machine replication – are apparently no longer the insurmountable barrier to automation we might have believed. Much of this technology has moved beyond mere speculation and into a prototyping phase, and of course some forms of workplace automation, like warehouse robotics, are already with us. The drone delivery systems and autonomous shipping vehicles, envisioned by companies like Amazon are still unproven, but the underlying computer vision systems they rely upon are developing quickly and a Covid investment push may well bring forward their timetable of deployment. In an economy increasingly reliant on now vulnerable service sector jobs, like transportation and retail, this could have a devastating impact.

These concerns regarding the relationship between human and computational vison were of course central to Harun Farocki’s own prescient investigations of machine vision and operational images, from military tracking systems to computer simulations. Today, artists like Heather Dewey-Hagborg and Adam Harvey, are producing work that compels us to think critically about our contemporary technologies of artificial perception, exposing the technical and social infrastructures that underpin facial recognition systems, for example. These artists help shed light on an already unfolding regime of vision and automation, one potentially accelerated in our post-Covid world.

[i] https://www.nytimes.com/2020/04/10/business/coronavirus-workplace-automation.html
[ii] https://www.brookings.edu/wp-content/uploads/2019/11/2019.11.20_BrookingsMetro_What-jobs-are-affected-by-AI_Report_Muro-Whiton-Maxim.pdf
[iii] https://www.forbes.com/sites/shahinfarshchi/2020/04/10/expect-more-jobs-and-more-automation-in-the-post-covid-19-economy/#5da3ec1629b4
[iv] https://www.oxfordmartin.ox.ac.uk/downloads/academic/future-of-employment.pdf
[v] https://www.ft.com/content/817228a2-82e1-11ea-b6e9-a94cffd1d9bf
[vi] http://www.image-net.org/challenges/LSVRC/
Joel McKim is Senior Lecturer in Digital Media and Culture and the Director of the Vasari Research Centre for Art and Technology at Birkbeck, University of London. He was recently a visiting fellow at the V&A Museum researching “A Pre-history of Machine Vision.”
September 17th, 2020 — Rosa Mercedes / 02
Interface

Olena Lyubchenko on Whiteness, Expropriation, War, and Social Reproduction in Ukraine (via LeftEast): “[…] when we hear on the news that ‘Ukraine is fighting a European war’ and ‘Ukraine is defending Europe’, amid images of fleeing ‘poor white’ women with children prioritized over racialized ‘Others’, ‘Ukraine’ is being made ‘white’ in the global imaginary. That is, “the injunction to ‘return to Europe’ by way of Europeanization is enabled and conditioned on the mythologies of Western civilization, and that Europeanization at once marks (promulgates) and unmarks (naturalizes) racial whiteness” [Nadezhda Husakouskaya and Randi Gressgård]. The paradox is that Europe’s existence as such has only been possible precisely because of the exploitation of global working peoples through expropriation of resources and today neoliberal economic reforms and reproduced by feminized labour.”

Vasyl Cherepanyn about the “inertness, hiding behind the European Wall” (via L’Internationale): “Many Western institutions that have been claiming ‘radical political engagement’ for years, have simply resorted to a white cube radicalism and self-satisfying humanitarianism, too afraid of acting politically beyond their comfort zone and unsettling their publics and authorities by attempting to affect the decision-making process regarding the Ukrainian cause.”

May 28th, 2022

Tatsiana Shchurko on the War in Ukraine, Entangled Imperialisms, and Transnational Feminist Solidarity, via LeftEast (May 2, 2022): “[An] uneven knowledge production and the many implications of the war against Ukraine reveal the dire need to develop a feminist anti-capitalist critique of multiple imperialisms. This language should grow from within the occupied and suppressed communities of Eastern Europe and Eurasia. An anti-imperialist and anti-capitalist feminist positionality grasps that the local is part of a global in an effort to build transnational connections of mutual aid and support against state and corporate violence. For example, statements of solidarity with Ukraine expressed by the International Committee of Indigenous Peoples of Russia and Native American communities along with the anti-war feminist march in Bishkek (Kyrgyzstan) on March 8, 2022, pointing out that the war in Ukraine should be of concern for a broad transnational community, may serve as instrumental examples of alternative anti-capitalist and anti-imperialist solidarities that stretch beyond state regulations and macro-politics and foreground decolonial perspectives, necessary in addressing entanglements of multiple imperialisms. Such solidarities also bring to light hidden interconnections of the past that allowed for distant communities to survive and support each other against the violence of imperialist intervention and its attendant capitalist exploitation. Thus, the march in Bishkek reminds of the socialist roots of the International Women’s Day to call for internationalist, intersectional, class solidarity against imperialism and militarism.”

Vasyl Cherepanyn on that “It’ll take more than tanks to ease Germany’s guilt” (via Politico): “Since the Soviet Union’s collapse, Germany has been imposing neocolonial optics on its Eastern European ‘peripheries,’ and on the post-Soviet space in particular, where Ukraine was long considered a gray buffer zone about which the EU was ‘deeply concerned.’ Germany didn’t bother itself much with differentiating between former Soviet countries’ pasts. Even until recently, any Ukrainian agenda in Germany was often ‘balanced’ with a Russian perspective, so as to not exclude the latter by any means.”

An unnamed anarchist and art scholar, who joined the Territorial Defense Forces, quoted by Olexii Kuchanskyi in an essay on “Digital Leviathan and His Nuclear Tail” (via Your Art and e-flux notes): “At dawn, Dima and I talked about cinema. Dima believes that cinema is inferior to literature as a means of expression because you spend much more time with a book than a film. It’s a really interesting point, something to dig into. I studied at the department of art theory & history and I never thought of it. Dima served in the military after school and worked at the factory all his life. He listens to rap, smokes pot, and tries to have fun. He is thirty-eight, his child was born last year. He likes Wong Kar-wai and is a fan of Asian cinema in general. Dima communicates by quoting Omar Khayyam, Confucius, and other awesome guys.”

April 20th, 2022

Vasyl Cherepanyn (Visual Culture Research Centre, Kyiv) on Putin’s “World War Z” and the West’s deadly “foot-dragging”, via Project Syndicate: “The main feature of this Western condition is constant belatedness. The West has always been too late, incapable of acting ahead and instead just reacting to what has already happened. As a Ukrainian joke went at the time, ‘While the European Union was taking a decision, Russia took Crimea.’ Then as now, Ukrainians wondered, ‘What is the West’s red line? What will compel the West to act instead of waiting and discussing when to intervene?’”

Barbara Wurm on Lithuanian director Mantas Kvedaravičius, killed in Mariupol, via Die Welt: “Kvedaravičius unfolded a whole spectrum of visual anthropology over a decade with only three films [Barzakh, Mariupolis, Parthenon]. It now awaits evaluation and exploration. The time will come. The films themselves make possible an infinite immersion in the matter of the world, between dream and reality, horror and everyday life, facts and phenomenal imagology.”

April 5th, 2022
moreless news