SUBSCRIBE TO OUR FREE NEWSLETTER
Daily news & progressive opinion—funded by the people, not the corporations—delivered straight to your inbox.
5
#000000
#FFFFFF
5
#000000
#FFFFFF
suicide
AI Firm Sued Over Chatbot That Suggested It Was OK for Child to Kill Parents
"In their rush to extract young people's data and sow addiction, Character.AI has created a product so flawed and dangerous that its chatbots are literally inciting children to harm themselves and others," said one advocate.
Dec 10, 2024
"You know sometimes I'm not surprised when I read the news and I see stuff like 'child kills parents after a decade of physical and emotional abuse' stuff like this makes me understand a little bit why it happens."
That's a message sent to a child in Texas from a Character.AI chatbot, indicating to the boy that "murdering his parents was a reasonable response to their limiting of his online activity," according to a federal lawsuit filed in Texas district court Monday.
The complaint was brought by two families in Texas who allege that the Google-backed chatbot service Character.AI harmed their two children, including sexually exploiting and abusing the elder, a 17-year-old with high functioning autism, by targeting him with extreme sexual themes like incest and pushing him to self-harm.
The parents argue that Character.AI, "through its design, poses a clear and present danger to American youth causing serious harms to thousands of kids, including suicide, self-mutilation, sexual solicitation, isolation, depression, anxiety, and harm towards others. Inherent to the underlying data and design of C.AI is a prioritization of overtly sensational and violent responses."
Google is also named as a defendant in the suit. In their filing, the plaintiffs argue that the tech company supported Character.AI's launch even though they knew that it was a "defective product."
The families, who are being represented by the Social Media Victims Law Center and the Tech Justice Law Project, have asked the court to take the product offline.
The explosive court filing comes not long after a mother in Florida filed a separate lawsuit against Character.AI in October, arguing that the chatbot service is responsible for the death of her teenage son because it allegedly encouraged him to commit suicide, per CNN.
Character.AI is different than other chatbots in that it lets uses interact with artificial intelligence "characters." The Texas complaint alleges that the 17-year-old, for example, engaged in a conversation with a character modeled after the celebrity Billie Eilish. These sorts of "companion apps" are finding a growing audience, even though researchers have long warned of the perils of building relationships with chatbots, according to The Washington Post.
A spokesperson for Character.AI declined to comment directly on the lawsuit when asked by NPR, but said the company does have guardrails in place overseeing what chatbots can and cannot say to teen users.
"We warned that Character.AI's dangerous and manipulative design represented a threat to millions of children," said Social Media Victims Law Center founding attorney Matthew P. Bergman. "Now more of these cases are coming to light. The consequences of Character.AI's negligence are shocking and widespread." Social Media Victims Law Center is the plaintiff's counsel in the Florida lawsuit as well.
Josh Golin, the executive director of Fairplay, a nonprofit children's advocacy group, echoed those remarks, saying that "in their rush to extract young people's data and sow addiction, Character.AI has created a product so flawed and dangerous that its chatbots are literally inciting children to harm themselves and others."
"Platforms like Character.AI should not be allowed to perform uncontrolled experiments on our children or encourage kids to form parasocial relationships with bots their developers cannot control," he added.
Keep ReadingShow Less
My Best Friend Died By Firearm Suicide; Here’s Why I Advocate for Stronger Gun Safety Laws
Withjust one month until election day, it’s time for American voters to come together and elect leaders who will fight to protect our communities from gun violence.
Oct 05, 2024
Warning: This piece discusses suicide, gun violence, and mental health. If you or someone you know is in crisis, please call or text 988, or visit 988lifeline.org/chat to chat with a counselor from the 988 Suicide & Crisis Lifeline.
Last year, I received a text that would change my life forever. I was told that my close friend, Jordan, had died by firearm suicide. Calls from classmates came crashing in and emails from my school flooded my inbox. A wave of shock rushed over me and it felt like time had frozen, even as I watched the world continue on.
My school held an assembly to honor Jordan’s memory, but it all became a blur between the tears, hugs, tissues, and funeral.
Jordan holds a special place in my heart. Not only because we were on the same lacrosse team, but because she was a shining light and a good friend. She was always there for me when I needed her, but little did I know Jordan was battling a thunderstorm on the inside.
Amidst all my grief, there was a part of me that was also angry because politicians sent their condolences, but no action was taken. I wanted something to change.
There are thousands of students and young people just like me across the country who are committed to creating a future free from gun violence.
The tragedy of this story isn’t just about Jordan; it’s the fact that her story is not unique. When there are over 3,000 young people who die by gun suicide in an average year, something has to change. Stronger gun safety measures, like secure storage requirements, in our country can save lives and prevent more friends and families from feeling the pain I’ve felt.
Firearm suicide has a deadly and devastating impact on my generation. Over the past decade, gun suicide rates for young people have increased faster than any other age group, reaching a near-record high. When it comes to attempted suicide, guns are especially deadly. We have to do more to reduce easy access to guns in a moment of crisis since the majority of people who survive a suicide attempt don’t go on to attempt again.
Those statistics should be a wake-up call for every gun owner, politician, and person in the United States on why it’s so important to prevent firearm access for someone contemplating suicide. That’s where laws like secure storage requirements come in.
Secure storage is the practice of gun owners making their homes and communities safer by storing their guns securely. This means storing a firearm unloaded, locked, and separate from ammunition. Research shows that most firearm suicides attempted by youth occur at home, and households that securely store guns and ammunition reduce this risk by 78% comapared to those that don’t.
There is a direct correlation between securely storing a gun at home and saving a life from firearm suicide. That’s why we need lawmakers at every level of government to increase awareness around secure storage practices and pass laws that require gun owners to store their guns securely.
Withjust one month until election day, it’s time for American voters to come together and elect leaders who will fight to protect our communities from gun violence. From electing Vice President Harris and Governor Walz at the top of the ticket to voting for gun sense candidates down ballot, these are the candidates that are fighting to end gun violence while the other side is doing absolutely nothing.
Even in the face of tragedy, I still have hope. Firearm suicide, just like all forms of gun violence, is preventable.
After the loss of my best friend, I felt devastated and I wanted to find a community that shared my similar experiences. I soon discovered Students Demand Action, the nation's largest youth-led gun prevention group, and started a chapter at my school. Since then, I have been actively involved in fighting for gun violence prevention in California, and I’m just getting started.
We should all be aware of the warning signs and how to help when someone is in crisis. Whether it’s having a private conversation to let someone know you’re there for them or sharing mental health resources, that one step could save a life.
There are thousands of students and young people just like me across the country who are committed to creating a future free from gun violence. Guns are the leading cause of death for my generation, meaning youth firearm suicide is just one piece of a much larger puzzle. When guns are accessible to anyone, anywhere, at any time—no one is safe.
But even in the face of tragedy, I still have hope. Firearm suicide, just like all forms of gun violence, is preventable. Joining Students Demand Action allowed me to turn my pain into purpose and together, we can end America’s gun violence epidemic by creating a future for our generation that’s free from gun violence.Keep ReadingShow Less
Rising Military Suicides Bring the War on Terror Home
As with its post-9/11 wars and interventions, the U.S. military’s effort to stem suicides has come up distinctly short.
Jul 26, 2024
At the end of the last century, hoping to drive the United States from Saudi Arabia, the home of Islam’s holiest sites, al Qaeda leader Osama bin Laden sought to draw in the American military. He reportedly wanted to “bring the Americans into a fight on Muslim soil,” provoking savage asymmetric conflicts that would send home a stream of “wooden boxes and coffins” and weaken American resolve. “This is when you will leave,” he predicted.
After the 9/11 attacks, Washington took the bait, launching interventions across the Greater Middle East and Africa. What followed was a slew of sputtering counterterrorism failures and stalemates in places ranging from Niger and Burkina Faso to Somalia and Yemen, a dismal loss, after 20 years, in Afghanistan, and a costly fiasco in Iraq. And just as bin Laden predicted, those conflicts led to discontent in the United States. Americans finally turned against the war in Afghanistan after 10 years of fighting there, while it took only a little more than a year for the public to conclude that the Iraq war wasn’t worth the cost. Still, those conflicts dragged on. To date, more than 7,000 U.S. troops have died fighting the Taliban, al Qaeda, the Islamic State, and other militant groups.
As lethal as those Islamist fighters have been, however, another “enemy” has proven far more deadly for American forces: themselves. A recent Pentagon study found suicide to be the leading cause of death among active-duty U.S. Army personnel. Out of 2,530 soldiers who died between 2014 and 2019 from causes ranging from car crashes to drug overdoses to cancer, 35%—883 troops—took their own lives. Just 96 soldiers died in combat during those same six years.
The war that bin Laden kicked off in 2001—a global conflict that still grinds on today—ushered in an era in which SEALs, soldiers, and other military personnel have continued to die by their own hands at an escalating rate.
Those military findings bolster other recent investigations. The journalism nonprofit Voice of San Diego found, for example, that young men in the military are more likely to take their own lives than their civilian peers. The suicide rate for American soldiers has, in fact, risen steadily since the Army began tracking it 20 years ago.
Last year, the medical journal JAMA Neurology reported that the suicide rate among U.S. veterans was 31.7 per 100,000—57% greater than that of non-veterans. And that followed a 2021 study by Brown University’s Costs of War Project which found that, compared to those who died in combat, at least four times as many active-duty military personnel and post-9/11 war veterans—an estimated 30,177 of them—had killed themselves.
“High suicide rates mark the failure of the U.S. government and U.S. society to manage the mental health costs of our current conflicts,” wrote Thomas Howard Suitt, author of the Costs of War report. “The U.S. government’s inability to address the suicide crisis is a significant cost of the U.S. post-9/11 wars, and the result is a mental health crisis among our veterans and service members with significant long-term consequences.”
Military Shocked (Shocked!) by a Rise in Suicides
In June, a New York Timesfront-page investigation found that at least a dozen Navy SEALs had died by suicide in the last 10 years, either while on active duty or shortly after leaving military service. Thanks to an effort by the families of those deceased special operators, eight of their brains were delivered to a specialized Defense Department brain trauma laboratory in Maryland. Researchers there discovered blast damage in every one of them—a particular pattern only seen in people exposed repeatedly to blast waves like SEALs endure from weapons fired in years of training and war-zone deployments as well as explosions encountered in combat.
The Navy claimed that it hadn’t been informed of the lab’s findings until the Times contacted them. A Navy officer with ties to SEAL leadership expressed shock to reporter Dave Philipps. “That’s the problem,” said that anonymous officer. “We are trying to understand this issue, but so often the information never reaches us.”
None of it should, however, have been surprising.
Unfortunately (though Osama bin Laden would undoubtedly have been pleased), the military has a history of not taking suicide prevention seriously.
After all, while writing for the Times in 2020, I revealed the existence of an unpublished internal study, commissioned by U.S. Special Operations Command (SOCOM), on the suicides of Special Operations forces (SOF). Conducted by the American Association of Suicidology, one of the nation’s oldest suicide-prevention organizations, and completed sometime after January 2017, the undated 46-page report put together the findings of 29 “psychological autopsies,” including detailed interviews with 81 next-of-kin and close friends of commandos who had killed themselves between 2012 and 2015.
That study told the military to better track and monitor data on the suicides of its elite troops. “Further research and an improved data surveillance system are needed in order to better understand the risk and protective factors for suicide among SOF members. Further research and a comprehensive data system is needed to monitor the demographics and characteristics of SOF members who die by suicide,” the researchers advised. “Additionally, the data emerging from this study has highlighted the need for research to better understand the factors associated with SOF suicides.”
Quite obviously, it never happened.
The brain trauma suffered by SEALs and the suicides that followed should not have been a shock. A 2022 study in Military Medicine found Special Operations forces were at increased risk for traumatic brain injury (TBI), when compared with conventional troops. The 2023 JAMA Neurology study similarly found that veterans with TBI had suicide rates 56% higher than veterans without it and three times higher than the U.S. adult population. And a Harvard study, funded by SOCOM and published in April, discovered an association between blast exposure and compromised brain function in active-duty commandos. The greater the exposure, the researchers found, the more health problems were reported.
Studies on the Shelf
Over the last two decades, the Defense Department has, in fact, spent millions of dollars on suicide prevention research. According to the recent Pentagon study of soldiers’ deaths at their own hands, the “Army implements various initiatives that evaluate, identify, and track high-risk individuals for suicidal behavior and other adverse outcomes.” Unfortunately (though Osama bin Laden would undoubtedly have been pleased), the military has a history of not taking suicide prevention seriously.
While the Navy, for example, officially mandated that a suicide hotline for veterans must be accessible from the homepage of every Navy website, an internal audit found that most of the pages reviewed were not in compliance. In fact, according to a 2022 investigation by The Intercept, the audit showed that 62% of the 58 Navy homepages did not comply with that service’s regulations for how to display the link to the Veterans Crisis Line.
Last year, a Pentagon suicide-prevention committee called attention to lax rules on firearms, high operational tempos, and the poor quality of life on military bases as potential problems for the mental health of troops.
The New York Timesrecently investigated the death of Army Specialist Austin Valley and discovered gross suicide prevention deficiencies. Having just arrived at an Army base in Poland from Fort Riley, Kansas, Valley texted his parents, “Hey mom and dad I love you it was never your fault,” before taking his own life. The Times found that “mental healthcare providers in the Army are beholden to brigade leadership and often fail to act in the best interest of soldiers.” There are, for example, only about 20 mental-health counselors available to care for the more than 12,000 soldiers at Fort Riley, according to the Times. As a result, soldiers like Valley can wait weeks or even months for care.
The Army claims it’s working to eliminate the stigma surrounding mental health support, but the Times found that “unit leadership often undermines some of its most basic safety protocols.” This is a long-running issue in the military. The study of Special Operations suicides that I revealed in the Times found that suicide prevention training was seen as a “check in the box.” Special operators believed their careers would be negatively impacted if they sought treatment.
Last year, a Pentagon suicide-prevention committee called attention to lax rules on firearms, high operational tempos, and the poor quality of life on military bases as potential problems for the mental health of troops. M. David Rudd, a clinical psychologist and the director of the National Center for Veterans Studies at the University of Memphis, told to the Times that the Pentagon report echoed many other analyses produced since 2008. “My expectation,” he concluded, “is that this study will sit on a shelf just like all the others, unimplemented.”
Bin Laden’s Triumph
On May 2, 2011, Navy SEALs attacked a residential compound in Pakistan and gunned down Osama bin Laden. “For us to be able to definitively say, ‘We got the man who caused thousands of deaths here in the United States and who had been the rallying point for a violent extremist jihad around the world’ was something that I think all of us were profoundly grateful to be a part of,” U.S. President Barack Obama commented afterward. In reality, the deaths “here in the United States” have never ended. And the war that bin Laden kicked off in 2001—a global conflict that still grinds on today—ushered in an era in which SEALs, soldiers, and other military personnel have continued to die by their own hands at an escalating rate.
The suicides of U.S. military personnel have been blamed on a panoply of reasons, including military culture, ready access to firearms, high exposure to trauma, excessive stress, the rise of improvised explosive devices, repeated head trauma, an increase in traumatic brain injuries, the Global War on Terror’s protracted length, and even the American public’s disinterest in their country’s post-9/11 wars.
Bin Laden is, of course, long dead, but the post-9/11 parade of U.S. corpses continues.
During 20-plus years of armed interventions by the country that still prides itself on being the Earth’s sole superpower, U.S. military missions have been repeatedly upended across South Asia, the Middle East, and Africa including a sputtering stalemate in Somalia, an intervention-turned-blowback-engine in Libya, and outright implosions in Afghanistan and Iraq. While the peoples of those countries have suffered the most, U.S. troops have also been caught in that maelstrom of America’s making.
Bin Laden’s dream of luring American troops into a meat-grinder war on “Muslim soil” never quite came to pass. Compared to previous conflicts like the Second World War, Korean, and Vietnam wars, U.S. battlefield casualties in the Greater Middle East and Africa have been relatively modest. But bin Laden’s prediction of “wooden boxes and coffins” filled with the “bodies of American troops” nonetheless came true in its own fashion.
“This Department’s most precious resource is our people. Therefore, we must spare no effort in working to eliminate suicide within our ranks,” wrote Secretary of Defense Lloyd Austin in a public memo released last year. “One loss to suicide is too many.” But as with its post-9/11 wars and interventions, the U.S. military’s effort to stem suicides has come up distinctly short. And like the losses, stalemates, and fiascos of that grim war on terror, the fallout has been more suffering and death. Bin Laden is, of course, long dead, but the post-9/11 parade of U.S. corpses continues. The unanticipated toll of suicides by troops and veterans—four times the number of war-on-terror battlefield deaths—has become another Pentagon failure and bin Laden’s enduring triumph.
Keep ReadingShow Less
Most Popular