skip to content

School of Arts and Humanities

 

John Milton's notes identified in an influential book he once owned

John Milton’s handwritten annotations have been identified in a copy of Holinshed's Chronicles, a vital source of inspiration for the Paradise Lost poet. The discovery, made by a team including Cambridge's Prof. Jason Scott-Warren, includes a rare example of prudish censorship.

Categories: Latest news

Call for safeguards to prevent unwanted ‘hauntings’ by AI chatbots of dead loved ones

Artificial intelligence that allows users to hold text and voice conversations with lost loved ones runs the risk of causing psychological harm and even digitally “haunting” those left behind without design safety standards, according to University of Cambridge researchers. 

‘Deadbots’ or ‘Griefbots’ are AI chatbots that simulate the language patterns and personality traits of the dead using the digital footprints they leave behind. Some companies are already offering these services, providing an entirely new type of “postmortem presence”.

AI ethicists from Cambridge’s Leverhulme Centre for the Future of Intelligence outline three design scenarios for platforms that could emerge as part of the developing  “digital afterlife industry”, to show the potential consequences of careless design in an area of AI they describe as “high risk”.

The research, published in the journal Philosophy and Technology, highlights the potential for companies to use deadbots to surreptitiously advertise products to users in the manner of a departed loved one, or distress children by insisting a dead parent is still “with you”.

When the living sign up to be virtually re-created after they die, resulting chatbots could be used by companies to spam surviving family and friends with unsolicited notifications, reminders and updates about the services they provide – akin to being digitally “stalked by the dead”.

Even those who take initial comfort from a ‘deadbot’ may get drained by daily interactions that become an “overwhelming emotional weight”, argue researchers, yet may also be powerless to have an AI simulation suspended if their now-deceased loved one signed a lengthy contract with a digital afterlife service. 

“Rapid advancements in generative AI mean that nearly anyone with Internet access and some basic know-how can revive a deceased loved one,” said Dr Katarzyna Nowaczyk-Basińska, study co-author and researcher at Cambridge’s Leverhulme Centre for the Future of Intelligence (LCFI).

“This area of AI is an ethical minefield. It’s important to prioritise the dignity of the deceased, and ensure that this isn’t encroached on by financial motives of digital afterlife services, for example.

“At the same time, a person may leave an AI simulation as a farewell gift for loved ones who are not prepared to process their grief in this manner. The rights of both data donors and those who interact with AI afterlife services should be equally safeguarded.”

Platforms offering to recreate the dead with AI for a small fee already exist, such as ‘Project December’, which started out harnessing GPT models before developing its own systems, and apps including ‘HereAfter’. Similar services have also begun to emerge in China.

One of the potential scenarios in the new paper is “MaNana”: a conversational AI service allowing people to create a deadbot simulating their deceased grandmother without consent of the “data donor” (the dead grandparent). 

The hypothetical scenario sees an adult grandchild who is initially impressed and comforted by the technology start to receive advertisements once a “premium trial” finishes. For example, the chatbot suggesting ordering from food delivery services in the voice and style of the deceased.

The relative feels they have disrespected the memory of their grandmother, and wishes to have the deadbot turned off, but in a meaningful way – something the service providers haven’t considered.

“People might develop strong emotional bonds with such simulations, which will make them particularly vulnerable to manipulation,” said co-author Dr Tomasz Hollanek, also from Cambridge’s LCFI.

“Methods and even rituals for retiring deadbots in a dignified way should be considered. This may mean a form of digital funeral, for example, or other types of ceremony depending on the social context.”

“We recommend design protocols that prevent deadbots being utilised in disrespectful ways, such as for advertising or having an active presence on social media.”

While Hollanek and Nowaczyk-Basińska say that designers of re-creation services should actively seek consent from data donors before they pass, they argue that a ban on deadbots based on non-consenting donors would be unfeasible.

They suggest that design processes should involve a series of prompts for those looking to “resurrect” their loved ones, such as ‘have you ever spoken with X about how they would like to be remembered?’, so the dignity of the departed is foregrounded in deadbot development.    

Another scenario featured in the paper, an imagined company called “Paren’t”, highlights the example of a terminally ill woman leaving a deadbot to assist her eight-year-old son with the grieving process.

While the deadbot initially helps as a therapeutic aid, the AI starts to generate confusing responses as it adapts to the needs of the child, such as depicting an impending in-person encounter.

The researchers recommend age restrictions for deadbots, and also call for “meaningful transparency” to ensure users are consistently aware that they are interacting with an AI. These could be similar to current warnings on content that may cause seizures, for example.

The final scenario explored by the study – a fictional company called “Stay” – shows an older person secretly committing to a deadbot of themselves and paying for a twenty-year subscription, in the hopes it will comfort their adult children and allow their grandchildren to know them.

After death, the service kicks in. One adult child does not engage, and receives a barrage of emails in the voice of their dead parent. Another does, but ends up emotionally exhausted and wracked with guilt over the fate of the deadbot. Yet suspending the deadbot would violate the terms of the contract their parent signed with the service company.

“It is vital that digital afterlife services consider the rights and consent not just of those they recreate, but those who will have to interact with the simulations,” said Hollanek.

“These services run the risk of causing huge distress to people if they are subjected to unwanted digital hauntings from alarmingly accurate AI recreations of those they have lost. The potential psychological effect, particularly at an already difficult time, could be devastating.”

The researchers call for design teams to prioritise opt-out protocols that allow potential users terminate their relationships with deadbots in ways that provide emotional closure.

Added Nowaczyk-Basińska: “We need to start thinking now about how we mitigate the social and psychological risks of digital immortality, because the technology is already here.”    

Cambridge researchers lay out the need for design safety protocols that prevent the emerging “digital afterlife industry” causing social and psychological harm. 

Tomasz HollanekA visualisation of one of the design scenarios highlighted in the latest paper


The text in this work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License. Images, including our videos, are Copyright ©University of Cambridge and licensors/contributors as identified. All rights reserved. We make our image and video content available in a number of ways – on our main website under its Terms and conditions, and on a range of channels including social media that permit your use and sharing of our content under their respective Terms.

Yes
Categories: Latest news

Reclaim ‘wellness’ from the rich and famous, and restore its political radicalism, new book argues

Today’s wellness industry generates trillions of dollars in revenue, but in a new book, Dr James Riley (Faculty of English & Girton College), shows that 1970s wellness pioneers imagined something radically different to today’s culture of celebrity endorsements and exclusive health retreats. 

“Wellness was never about elite experiences and glossy, high-value products,” says Riley, noting that “When we think of wellness today, Gwyneth Paltrow’s Goop and other lifestyle brands might come to mind, along with the oft-cited criticism that they only really offer quackery for the rich.” By contrast, in the 1970s, “wellness was much more practical, accessible and political.” 

The word, as it was first proposed in the late-1950s, described a holistic approach to well-being, one that attended equally to the mind (mental health), the body (physical health) and the spirit (one’s sense of purpose in life). The aim was to be more than merely ‘not ill’. Being well, according to the likes of Halbert Dunn and later in the 1970s, John Travis and Don Ardell, meant realising your potential, living with ‘energy to burn’ and putting that energy to work for the wider social good.

Riley’s Well Beings: How the Seventies Lost Its Mind and Taught Us to Find Ourselves, published by Icon Books on 28th March, is the first book to explore the background of the wellness concept in the wider political and cultural context of the 1970s. 

“Wellness in the 1970s grew out of changing attitudes to health in the post-war period – the same thinking that gave rise to the NHS,” Riley says. “When coupled with the political activism of the 1960s counterculture and the New Left, what emerged was a proactive, socially oriented approach to physical and mental well-being. This was not about buying a product off the shelf. 

“The pursuit of wellness was intended to take time, commitment and effort. It challenged you to think through every facet of your life: your diet, health, psychology, relationships, community engagement and aspirations. The aim was to change your behaviour – for the better – for the long term.”

Riley’s book also makes a case for what the 1970s wellness industry can do for us today.
 
“We’re often warned about an imminent return to ‘the seventies’, a threat that’s based on the stereotypical image of the decade as one of social decline, urban strife, and industrial discontent. It’s an over-worked comparison that tends to say more about our own social problems, our own contemporary culture of overlapping political, social and economic crises. Rather than fearing the seventies, there’s much we can learn to help us navigate current difficulties.”  

“It was in the 1970s that serious thought was given to stress and overwork to say nothing of such frequently derided ‘events’ as the mid-life crisis and the nervous breakdown. The manifold pressures of modern life - from loneliness to information overload - increasingly came under the microscope and wellness offered the tools to deal with them.” 

“Not only are these problems still with us, they’ve got much worse. To start remedying them, we need to remember what wellness used to mean. The pandemic, for all its horrors, reminded us of the importance of mutual self-care. To deal with the ongoing entanglement of physical and mental health requires more of that conviviality. Being well should be within everyone’s reach, it should not be a privilege afforded to those who have already done well.”

Mindfulness versus wellness

At the heart of Riley’s book is an analysis of the ongoing corporate and commercial tussle between ‘mindfulness’ and ‘wellness’. 

In 1979 Dr Jon Kabat-Zinn founded the Stress Reduction and Relaxation Programme at the University of Massachusetts Medical Center, where he taught ‘mindfulness-based stress reduction’. For Kabat-Zinn mindfulness meant accepting the inevitable stress that comes with the ‘full catastrophe’ of life and adopting an attitude of serene resilience in the face of it. Stress could be alleviated thanks to a regular meditation routine and small changes made to the working day such as the decision to try a different, more pleasant commute. Little was said about altering the pace of the work causing the stress in the first place. 

By contrast, John Travis, a medical doctor who founded the Wellness Resource Center in California’s Marin County in 1975, talked about the health dangers of sedentary, office-based jobs while Don Ardell, author of High Level Wellness (1977), encouraged his readers to become agents of change in the workplace. Both saw work-fixated lifestyles as the problem. Work and work-related stress was thus something to fix, not to endure.     

Ardell argued that because burn-out was becoming increasingly common it was incumbent upon employers to offer paid time off to improve employee well-being. Better to be too well to come to work, reasoned Ardell, than too sick. “We tend to think that flexible hours and remote working are relatively new concepts, particularly in the digital and post-COVID eras,” adds Riley, “but Ardell was calling for this half a century ago.” 

Riley argues that the techniques of mindfulness, rather than those of wellness, have proved attractive to contemporary corporate culture because they ultimately help to maintain the status quo. Corporate mindfulness puts the onus on the employee to weather the storm of stress. It says, “there is nothing wrong with the firm, you are the problem, this is the pace, get with it or leave”.  

According to Riley this view is a far-cry from the thinking of seventies wellness advocates like Travis and Ardell who “imagined a health-oriented citizenship, a process of development in which social well-being follows on from the widespread optimistic and goal-oriented pursuit of personal health. It’s that sense of social mission that self-care has lost.”

Riley points out that this self-care mission had a very particular meaning in the 1970s among groups like The Black Panther Party for Self-Defense, which established clinics and ran an ambulance service for black communities in and around Oakland, California. “They were saying you’ve got to look after yourself so you can then look after your community. Such communal effort was vital because the system was seen to be so opposed to Oakland’s needs. One sees the deeply political potency of ‘self-care’ in this context. It meant radical, collective autonomy, not indulgent self-regard.”

The Bad Guru

As well as suggesting positive lessons from the past, Riley is also quick to call out the problems. “The emphasis on self-responsibility in wellness culture could easily turn into a form of patient-blame,” he argues, “the idea that if you’re ill, or rather if you fail to be well, it’s your fault, a view that neglects to consider all kinds of social and economic factors that contribute to ill-health.”

Elsewhere, Riley draws attention to the numerous claims of exploitation and abuse within the wider context of the alternative health systems, new religious movements and ‘therapy cults’ that proliferated in the 1970s. 

“It was not always a utopia of free thought. The complex and often unregulated world of New Age groups and alternative health systems could often be a minefield of toxic behaviour, aggressive salesmanship and manipulative mind games. Charismatic and very persuasive human engineers were a common presence in the scene, and one can easily see these anxieties reflected in the various ‘bad gurus’ of the period’s fiction and film. 

“There are plenty of voices who say they gained great insights as a result of being pushed to their limits in these situations,” says Riley, “but many others were deeply affected, if not traumatised, by the same experiences.”


Self-Experimentation 

In addition to exploring the literature of the period, Riley’s research for Well Beings found him trying out many of the therapeutic practices he describes. These included extended sessions in floatation tanks, guided meditation, mindfulness seminars, fire walking, primal screaming in the middle of the countryside, remote healing, yoga, meal replacement and food supplements.

 

References

J. Riley, Well Beings: How the Seventies Lost Its Mind and Taught Us to Find Ourselves. Published by Icon Books on 28th March 2024. ISBN: 9781785787898.

A new cultural history of the 1970s wellness industry offers urgent lessons for today. It reveals that in the seventies, wellness was neither narcissistic nor self-indulgent, and nor did its practice involve buying expensive, on-trend luxury products. Instead, wellness emphasised social well-being just as much as it focused on the needs of the individual. Wellness practitioners thought of self-care as a way of empowering people to prioritise their health so that they could also enhance the well-being of those around them.

Wellness was much more practical, accessible and politicalJames RileyEli Christman via Flikr under a cc licensePeople doing yoga together outdoors in Richmond USA in 2015


The text in this work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License. Images, including our videos, are Copyright ©University of Cambridge and licensors/contributors as identified. All rights reserved. We make our image and video content available in a number of ways – on our main website under its Terms and conditions, and on a range of channels including social media that permit your use and sharing of our content under their respective Terms.

YesLicence type: Attribution-Noncommerical
Categories: Latest news