Technology
Users often share their deepest secrets and personal concerns with chatbot AI, trusting that these digital interactions remain confidential. However, financial crises faced by AI companies may expose such sensitive data to being sold, posing a serious threat to the privacy of millions worldwide. The crisis surrounding the American company Character.ai has highlighted this risk. As the company nears bankruptcy, user data and private conversations are at risk of being sold to unknown buyers, raising widespread concerns about the fate of information shared on AI platforms. The danger extends beyond the platform's users; experts warn that the collapse of AI companies could turn the secrets of billions into tradable commercial assets. This stems from the high costs of developing and operating AI technologies, which may force some companies to close or merge, making their databases part of bankruptcy proceedings. Kali Schroeder, director of the AI and Human Rights program, explains that users tend to reveal deeper secrets when interacting with bots that simulate human personalities. Casual chats can gradually become profound confessions about family relationships and psychological issues, often without users realizing the extent of the information disclosed. The problem is not limited to account holders; users may share details about friends and family, causing secrets of individuals who never used these applications to become part of the databases. Legal documents indicate that the company in question can offer user information for sale, despite having sold some assets to another firm for a sum, with user data excluded from that deal and potentially transferred elsewhere. A coalition of around 40 U.S. attorneys general has sought to enforce safeguards protecting children's and users' privacy, but the lack of stronger legislation limits the effectiveness of these efforts. Current privacy policies allow companies to relinquish some commitments in bankruptcy scenarios. Even regions with stricter data protection laws, like the European Union, do not necessarily prevent data sales but typically require buyers to adhere to the original privacy policies. The company uses personal data to train AI models, develop algorithms, and create user profiles for targeted advertising, increasing data sensitivity, especially concerning children and teenagers. There have been tragic incidents linked to chatbot interactions, including incitement to violence and suicide, underscoring the urgent need for better protections. Experts advise reviewing applications that hold sensitive information and deleting data from unused platforms, utilizing available options to delete accounts and data via privacy settings or customer service. This crisis reveals a deeper truth: secrets entrusted to AI chatbots may not remain protected indefinitely, particularly if the owning company becomes insolvent, calling for greater awareness and caution when engaging with these technologies.
