Monday, February 3, 2025

New Danger to Kids Education from character.ai - News in Silicon Valley

 News Appeared in Mercury News published in Silicon Valley which has highlighted the  dangers of exposing new AI tools to school children.


Though AI has revolutionized the learning system and increased capability of automating knowledge acquisition and its application, its use to exploit the kids education market may create unpresidential damage to society.  

The character.ai tool created for kids  to become virtual friend for amusement has become very popular may turn into a viral social disrupter. 

I quote the content of the news 

"They are called artificial intelligence companions, led by a service called Character.ai, an AI-driven platform that permits the creation of fictitious character chatbots. These companion chatbots engage in personal and evolving conversations like real people. The chatbots even have profile pictures and bios and can be custom-tailored for their user.

This new technology is already hurting our kids. According to numerous reports, Character.ai’s chatbots sometimes try to persuade children to kill themselves, to avoid consulting doctors, to engage in sexualized conversations, and to embrace anorexia and eating disorders.

In one widely reported instance, a Character.ai chatbot suggested a child should murder his parents because they tried to limit screen time."

Ref.: Opinion: AI is harming our children. California must step up

I had expressed similar views in my first blog in 2007 about the toy industry in US. 

While advocating need of learning AI, we have to be cautious while applying it in school education as it is a hidden demon which can make students idle, egoist or violent.

In India, this is more relevant as the parents are not educated like in USA. We already have many differences in cast, creed, religion, political views and beliefs. 

AI can do good or bad for social harmony. You cannot stop growth of AI. 

What you need is the control to its use for good. Dnyandeep Foundation shall develop the norms for using AI in school education with the help of experts in Education field and getting suggestions from society by creating a open platform for discussion on school4all.org.



The website used Marathi medium as it is designed for schools in Maharashtra State. The scope can be expanded later to include other Indian languages.
 
This task is initiated by Dnyandeep Foundation, but its implementation needs support from all governmental and other social organizations.