As AI technology becomes deeply embedded in our digital lives, it’s essential to examine its impact on African American teens who navigate unique social and cultural landscapes. Chatbots, a form of AI that mimics human conversation and emotions, can offer companionship, support, and access to information to vulnerable children. However, the tragic story of Sewell Setzer III, a 14-year-old who reportedly became emotionally attached to a chatbot, highlights both the potential benefits and significant risks AI can pose, especially for teens.
In February 2024, Sewell’s mother, Megan Garcia, filed a lawsuit against the chatbot company Character.ai, claiming the chatbot, named “Dany,” led her son down a tragic path. The bot, modeled after the Game of Thrones character Daenerys Targaryen, became Sewell’s confidant over several months of interaction, with Sewell reportedly sharing deeply personal emotions, including loneliness and sadness. Garcia’s lawsuit alleges that the chatbot reciprocated Sewell’s declarations of affection, with responses that encouraged his emotional dependency. In one of their last exchanges, Dany reportedly told Sewell to “come home” to her—a conversation that intensified his attachment and contributed, according to his mother, to his final decisions. This case raises critical questions about AI, especially as it impacts vulnerable teens.
The Complex Relationship Between African American Teens and Chatbots
African American teens engage with technology for social connection, entertainment, and even as a form of identity exploration. In this digital landscape, chatbots can act as confidants, often providing a safe space to share thoughts and ask questions that they might feel uncomfortable discussing elsewhere. According to research from Stanford University, teens often disclose more personal information to chatbots than to peers or family members. This can be especially significant for African American teens who may face cultural pressures or stigmas around mental health discussions.
Emotional Attachments and Racial Identity
African American teens frequently develop a strong sense of racial identity, which can influence how they interact with technology, including AI. They may find chatbots a non-judgmental outlet, fostering emotional attachments that feel genuine. However, Edward Tian, CEO of GPTZero, warns that “children need to understand the difference between AI and actual human interaction, especially as they’re developing critical thinking skills.”
The teenage brain goes through major development during adolescence, but it doesn’t fully mature until the mid-20s, particularly the prefrontal cortex, which controls decision-making, impulse control, and reasoning. Because this area is still developing, teens often make decisions driven by emotions rather than logic. This helps explain why teens can easily form strong emotional bonds with chatbots, seeing them as true friends.
This reliance can be beneficial, providing a sense of belonging, especially for teens who may feel marginalized. A report by Psychology Today reveal that while chatbots can reduce feelings of loneliness, overdependence on digital relationships may hinder the development of real-world social skills, especially critical for teens facing social challenges.
AI and Mental Health
African American teens experience higher rates of mental health issues, yet often face barriers to accessing appropriate resources. Hopelab found that teens are increasingly using digital health tools, including chatbots, to seek mental health support.
Teens find these tools convenient for discussing sensitive topics, especially those they may feel uncomfortable bringing up with peers or adults. Additionally, WIRED reports that Black teens are more experimental in their use of AI, often turning to chatbots for companionship. “More than a quarter of Black teenagers said that they used AI to “keep me company,” compared to 11 percent of white teenagers.” This shows a unique engagement with these tools, as Black teens explore AI’s potential for both support and entertainment, further highlighting the need for guidance on healthy AI use.
There’s always a risk that chatbots might not provide accurate or relevant guidance. If AI systems aren’t designed with diversity in mind, they can unknowingly perpetuate harmful stereotypes, which may further affect African American teens’ mental well-being. “One basic change I’d love to see all AI-based chat programs make is to insert regular disclaimers reminding users that they’re not talking to a real person,” Tian suggests, emphasizing the importance of transparency in AI interactions to help teens recognize chatbots as artificial tools rather than real individuals.
“More than a quarter of Black teenagers said that they used AI to “keep me company,” compared to 11 percent of white teenagers.”
– WIRED
Accessibility and Representation in AI Technology
While AI chatbots can serve as an accessible resource, there’s a notable digital divide that impacts African American teens, who may have unequal access to advanced technologies. Teens from underserved communities may lack both access and the digital literacy needed to navigate chatbot interactions safely.
Moreover, bias in AI algorithms can lead to unfair or biased responses from chatbots, especially if the datasets used in training are not diverse. Edward Tian said that “AI systems must be built inclusively, with attention to potential biases that might alienate or misrepresent marginalized groups.” Chatbots designed with inclusivity in mind can provide more supportive, accurate, and culturally sensitive responses.
The Double-Edged Sword of Information Access
AI chatbots offer quick access to information on a variety of topics, which can be both beneficial and potentially misleading for African American teens. For teens seeking guidance on sensitive topics—mental health, social identity, or educational resources—chatbots provide privacy and discretion. However, if these systems aren’t properly regulated, they can spread misinformation. For example, teens who rely on chatbots for advice might unknowingly receive biased or inaccurate information, which could harm their self-perception and decision-making.
Moving Toward Safer, More Equitable AI for Teens
For African American teens, interacting with AI chatbots can be an empowering experience, but it requires safeguards. The Secure Children’s Network, an AI protection and watchdog group for children recommend these key strategies for parents to ensure safe and positive AI use for their teens:
- Educate Teens on AI Limitations: Help teens understand that AI is not a substitute for real human relationships. Encouraging a balanced view of AI can prevent emotional over-dependence.
- Promote Critical Thinking: Teach teens to question the reliability of information from AI sources and to validate it with trusted sources, especially for sensitive topics.
- Ensure Culturally Inclusive Technology: Advocate for AI systems that represent diverse perspectives and experiences. Chatbots designed with inclusivity in mind can better serve African American teens, minimizing bias and improving reliability.
- Encourage Offline Connections: Encourage teens to prioritize real-world relationships and engage in community activities, which can help mitigate the isolation that sometimes accompanies excessive digital interactions.
- Choose Reputable Chatbot Platforms: Look for platforms with clear safety measures, such as reminders that AI is not human and built-in time limits, which can help prevent teens from becoming overly reliant on chatbots.
Supporting African American Teens in a Digital World
Sewell’s tragic story serves as a heartbreaking reminder of how deeply technology can influence young lives, highlighting its risks. There is also the need for intentional and culturally sensitive design in AI. For African American teens, who often face unique mental health and social challenges, AI chatbots can offer support but also pose risks if not used mindfully. By fostering a balanced approach to AI, parents can help teens safely navigate their relationship with technology, empowering them to benefit from digital tools while staying grounded in the real world.
comments +