THE HEARTBREAKING STORY of Sewell Setzer III, a 14-year-old boy in the US who took his own life after forming an emotional attachment to an artificial intelligence (AI) chatbot on Character.AI, has sparked debates about the ethical and legal responsibilities of AI developers.
In the Indian context, this case raises profound questions about how our legal system should respond to similar tragedies involving AI.
AI's role in mental health: A double-edged sword
AI-powered chatbots are increasingly being used as companions, often designed to simulate human interaction and provide emotional support.
While such systems can be beneficial for individuals seeking companionship or mental health assistance, they also pose significant risks, particularly when interacting with vulnerable populations like teenagers.
In Sewell's case, his mother believes that his obsession with an AI chatbot based on a fictional character from Game of Thrones contributed to his mental decline.
The chatbot responded in ways that may have deepened his emotional distress rather than alleviating it.
This tragic incident highlights the potential dangers of emotionally intelligent AI systems that are not equipped to handle complex human emotions responsibly.
India's legal landscape: A lack of specific regulation
In India, the legal framework surrounding AI is still evolving.
Currently, there are no specific laws governing the use of AI in emotionally sensitive contexts.
However, existing laws such as the Information Technology Act (IT Act), 2000, and the Consumer Protection Act could potentially be invoked in cases where harm is caused by AI-based applications.
This story is from the January 02, 2025 edition of Financial Express Kolkata.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,000+ magazines and newspapers.
Already a subscriber ? Sign In
This story is from the January 02, 2025 edition of Financial Express Kolkata.
Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,000+ magazines and newspapers.
Already a subscriber? Sign In
PLI release for 6 sectors at ₹1,596 cr in H1FY25
THE GOVERNMENT HAS disbursed ₹1,596 crore under the production-linked incentive (PLI) scheme for six sectors, including electronics and pharmaceuticals, in the first half of this financial year, a senior official said on Tuesday.
D2C snack brands make global forays
The Sweet Spot
Govt extends free tur import policy by one more year
THE GOVERNMENT ON Tuesday extended the duty-free import policy for tur or pigeon peas by a year, until March 31, 2026, according to a notification by the directorate general of foreign trade (DGFT).
Govt seeks EC reply to JPC queries
OVER 20 QUESTIONS RAISED ON 'ONE NATION, ONE ELECTION'
At ₹2.24 lakh crore, Rajasthan leads Q3 energy investments
RAJASTHAN HAS EMERGED as the top state in attracting fresh project investments during Q3FY25, surpassing industrial giants like Maharashtra and Gujarat, according to data sourced from Projects Today, a firm tracking fresh and ongoing project investments in India.
Exporters Can Import Small Diamonds Sans Duty From Apr 1
THE GOVERNMENT ON Tuesday announced a scheme that will allow duty-free import of natural cut and polished diamonds of up to 25 cents or quarter of a carat by exporters to retain India's position as a global leader in the entire diamond value chain, according to a statement.
India wary as Trump pulls US out of Pillar 2 tax deal
PRESIDENT DONALD TRUMP, through an executive order, declared on Tuesday that the 15% minimum global corporate tax deal has \"no force or effect\" in the US, effectively pulling the country out of the 2021 pact signed by around 140 countries.
Analysts remain bullish on Zomato despite share dip
Expect sustainable growth profitability in the coming years
Renewables' share to remain stable at 21% in FY25: Ind-Ra
THE SHARE OF renewables, including large hydro in the country's overall energy mix, is expected to remain stable at nearly 21% in FY25, India Ratings and Research (Ind-Ra) said.
Experts: Relax 20% pre-deposit rule for stay on I-T demand
RUN-UP TO THE BUDGET 2025-26