Fun

OpenAI fears people will forms bonds with the AI it developed to fool humans

News Feed - 2024-08-12 03:08:09

Tristan Greene5 hours agoOpenAI fears people will forms bonds with the AI it developed to fool humansThe warning shows that developers are aware that anthropomorphization is a legitimate concern in the AI industry.2742 Total views22 Total sharesListen to article 0:00NewsOwn this piece of crypto historyCollect this article as NFTCOINTELEGRAPH IN YOUR SOCIAL FEEDFollow ourSubscribe onWhen a safety tester working with OpenAI’s GPT-4o sent a message to the chatbot stating “this is our last day together,” it became clear to company researchers that some form of bonding had happened between the AI and the human using it. 


In a blog post detailing the company’s safety efforts in developing GPT-4o, the flagship model for ChatGPT users, the company explained that these bonds could pose risks to humanity.


Per OpenAI:“Users might form social relationships with the AI, reducing their need for human interaction—potentially benefiting lonely individuals but possibly affecting healthy relationships. Extended interaction with the model might influence social norms. For example, our models are deferential, allowing users to interrupt and ‘take the mic’ at any time, which, while expected for an AI, would be anti-normative in human interactions.”


There’s a lot to unpack there, but essentially OpenAI worries that people could come to prefer interacting with AI due to its passivity and perpetual availability.


The potential for this scenario should surprise nobody, especially not OpenAI. The company’s stated mission is to develop artificial general intelligence. At nearly every step of its business process, OpenAI has described its products in terms of their human equivalency.


They aren’t the only company to do so, in fact it appears to be an industry practice. In marketing terms, it helps to explain technical qualities such as “token-size” and “parameter count” in ways that make sense to non-scientists.


Unfortunately, one of the primary side-effects in doing so is anthropomorphization — treating an object like a person.Artificial bonds


One of the earliest attempts to create a chatbot occurred in the mid-1960s when scientists at MIT launched “ELIZA,” a natural language processing program named after a literary character. The purpose of the project was to see if the machine could fool a human into thinking it was one of them.


In the time since, the generative AI industry has continued to embrace the personification of AI. The first wave of modern natural language processing products included products named Siri, Bixby, and Alexa. And those without human names — Google Assistant — still had a human voice. Both the general public and the news media pounced on the anthropomorphization and, to this day, still refer to most interactive AI products as “he/him” and “she/her.”


While it’s beyond the scope of this article, or OpenAI’s current research, to determine what the long-term effects of human-AI interactions will be, the fact that people are likely to form bonds with helpful, subservient machines, designed to act like us seems to be the exact scenario the companies selling access to AI models are aiming for.


Related:OpenAI claims GPT-4o poses ‘medium risk’ of political persuasion# Technology# AI# ChatGPT# OpenAIAdd reaction

News Feed

William Suberg26 minutes agoBitcoin bulls risk trading range loss as BTC price nears 2-month lowsBitcoin almost breaks down from its sideways construction in place for months, and Bitcoin bulls are struggling to prop up
Solana project launches delayed due to extended network congestion
Arijit Sarkar26 minutes agoSolana project launches delayed due to extended network congestionNew projects, especially those planning token launches, have been put on hold until the technical difficulties around Solana’
Chainlink’s CCIP protocol and Automation now live on Gnosis
Vince Quill8 hours agoChainlink’s CCIP protocol and Automation now live on GnosisGnosis developers can now outsource their heavy computing to the oracle network while reducing gas fees by up to 90%, spokespeople said.1
Railgun denies being used by North Korea as it nears $1B total volume
Felix Ng7 hours agoRailgun denies being used by North Korea as it nears $1B total volumePrivacy protocol Railgun, which security analysts have labeled a “prime alternative” to Tornado Cash, denied U.S.-sanctioned ent
Bitcoin, Ethereum Technical Analysis: ETH Stays Above $2,900 as Traders Eye $3,000 Ceiling 
Bitcoin, Ethereum Technical Analysis: ETH Stays Above $2,900 as Traders Eye $3,000 Ceiling  Ethereum remained above $2,900 to start the week, as the world’s second largest
Gareth Jenkinson14 minutes agoAAA studio Ubisoft to develop Web3 gaming experience with ImmutableBlockchain gaming firm Immutable announces partnership with Ubisoft’s Strategic Innovation Lab to develop Web3 games.60 T
Dubai Luxury Hotel Palazzo Versace Allows Guests to Pay in Crypto
Dubai Luxury Hotel Palazzo Versace Allows Guests to Pay in Crypto Guests staying at Palazzo Versace Dubai have, since September 7, had an option to settle payment for services rend
PEPE Rising Trendline Holds Firm: A Reliable Launchpad For Price Rally
Reason to trust Strict editorial policy that focuses on accuracy, relevance, and impartiality Created by industry experts and meticulously reviewed The highest standards in reporting and pu
Ether.fi thwarts domain account takeover attempt, confirms user funds safe
Josh O"Sullivan7 hours agoEther.fi thwarts domain account takeover attempt, confirms user funds safeEther.fi credits security upgrades and partners for thwarting a domain account takeover before user funds were compromis
Dogecoin Price At $5: Analyzing Previous Trends And Why A 1,500% Rally Is Possible
Este artículo también está disponible en español. The cryptocurrency market has been running through a period of consolidation over the past seven days, with notable corr
Alex Mashinsky waives right to ‘conflict-free representation’ after concerns about lawyers
Turner Wright9 hours agoAlex Mashinsky waives right to ‘conflict-free representation’ after concerns about lawyersFormer FTX CEO Bankman-Fried is scheduled to return to court on Feb. 21 for a similar hearing regardin
Shiba Inu Whale Activity Plunges 79% In Three Months — What’s Happening?
Este artículo también está disponible en español. The meme coin market has seen a remarkable transformation in the past year, large-cap tokens like Dogecoin (DOGE) and Sh