Fun

Former OpenAI employee quit to avoid ‘working for the Titanic of AI’

News Feed - 2024-07-12 05:07:44

Tristan Greene3 hours agoFormer OpenAI employee quit to avoid ‘working for the Titanic of AI’The real question is: Who or what is the iceberg in this scenario?627 Total views2 Total sharesListen to article 0:00NewsOwn this piece of crypto historyCollect this article as NFTJoin us on social networksWilliam Saunders, a former OpenAI employee and member of the company’s “superalignment team,” recently disclosed that he quit the company because he felt it was on a collision course with tragedy, much like the ill-fated R.M.S. Titanic in 1912.


As spotted by Business Insider, Saunders gave his commentary during an episode of technology journalist Alex Kantrowitz’s podcast.


Saunders told Kantrowitz that during his three years at OpenAI, he would sometimes ask himself if the company was on a path that was “more like the Apollo program or more like the Titanic.“


His reasoning appears to be that through cautious scientific effort, the Apollo space program was a success despite its setbacks, whereas the Titanic was a failure despite its successes.


Per Saunders:“Lots of work went into making the ship safe and building watertight compartments so that they could say that it was unsinkable. But at the same time, there weren’t enough lifeboats for everyone.”OpenAI as the Titanic


Saunders describes the company’s general ethos as one that places a higher priority on product development than on implementing reasonable safety precautions.


He paints a picture of an office where employees who raise safety concerns are punished, and leadership is focused on profit.


“Over time,” said Saunders, “it started to really feel like the decisions being made by leadership were more like the White Star Line building the Titanic.”The iceberg


Saunders isn’t the first person to disagree with the way OpenAI is allegedly doing business. Elon Musk, one of the company’s estranged co-founders, recently sued it over claims it had strayed too far from its original mission. This is despite the fact that Musk hasn’t had any involvement with OpenAI for years and currently operates his own direct competitor, xAI. The suit was subsequently withdrawn. 


Rival AI company Anthropic was founded in 2021 by former OpenAI employees and co-founders over concerns that OpenAI wasn’t focused enough on trust and safety. 


On the flip side, though, Ilya Sutskever, another now estranged co-founder and its former chief scientist, departed the company in May 2024 to start his own company, writing at the time that he was “confident” the OpenAI team would be able to safely meet its goals.


With so many employees jumping ship, and the Titanic analogy being bandied about by at least one, the question at hand is: Who or what is the iceberg?


If the passengers in the analogy are us — all humankind — then the iceberg represents the existential threat that ChatGPT and systems like it pose to an unprepared society. If AI becomes more intelligent and capable than us, and we don’t have enough “lifeboats” to protect everyone from its potential for harm, then we could be headed for tragedy.


But if the passengers are shareholders and stakeholders waiting for OpenAI to create AI that’s as smart as humans, and that never happens, then perhaps the iceberg represents the bursting of the generative AI bubble.


Related:Big Tech faces financial reckoning if human-level AI doesn’t happen soon# AI# ChatGPT# OpenAIAdd reaction

News Feed

Trezor X account shills fake presale tokens in suspected hack
Brayden Lindrea5 hours agoTrezor X account shills fake presale tokens in suspected hackThe official X account for Trezor began asking users to send crypto to an unknown wallet address and posted nefarious links to a frau
Crypto mixing is ‘not a crime,’ says CryptoQuant CEO
Zoltan Vardai12 hours agoCrypto mixing is ‘not a crime,’ says CryptoQuant CEOThe arrest of the founders of Samourai Wallet led to widespread concerns in the crypto community that the U.S. government was attempting to
Savannah Fortis10 hours agoElon Musk says X will offer an ‘entire financial world’ in the coming monthsIn light of Twitter’s rebranding, Elon Musk says users can expect to conduct their “entire financial world”
Bitcoin halving will be a litmus test for inefficient ops: Mining execs
Gareth Jenkinson9 hours agoBitcoin halving will be a litmus test for inefficient ops: Mining execsMajor mining firms expect the Bitcoin halving to reduce profitability and cause an increase in network fees, which could c
5% Over Spot: Gold-Backed Tokens Tether Gold and Digix Sell for Higher Premiums
5% Over Spot: Gold-Backed Tokens Tether Gold and Digix Sell for Higher Premiums Digital asset markets have been gathering some gains during the last few days and tokens like stab
Gareth Jenkinson14 minutes agoAAA studio Ubisoft to develop Web3 gaming experience with ImmutableBlockchain gaming firm Immutable announces partnership with Ubisoft’s Strategic Innovation Lab to develop Web3 games.60 T
Bitcoin Proponents Slam Nobel Laureate Paul Krugman After Venmo Payment Issue
Bitcoin Proponents Slam Nobel Laureate Paul Krugman After Venmo Payment Issue Nobel Prize winner Paul Krugman complained on Twitter Wednesday that he was experiencing issues with t
Turner Wright3 hours agoSam Bankman-Fried denies knowledge of moving FTX deposits to North Dimension: ReportAssistant U.S. Attorney Danielle Sassoon grilled the former FTX CEO in court on his knowledge of FTX user deposi
Hong Kong’s SFC issues warning against MEXC
Zoltan Vardai12 hours agoHong Kong’s SFC issues warning against MEXCThe financial watchdog’s warning comes a day after it cautioned investors about Bybit exchange.1424 Total views7 Total sharesListen to article 0:00N
Global Investment Bank Morgan Stanley Launches Dedicated Cryptocurrency Research Team
Global Investment Bank Morgan Stanley Launches Dedicated Cryptocurrency Research Team Global investment bank Morgan Stanley is establishing a new cryptocurrency research team. 
Former SEC official David Hirsch says he is not joining Pump​.fun
Vince Quill6 hours agoFormer SEC official David Hirsch says he is not joining Pump​.funRumors have been circulating that the recently retired SEC veteran is taking on a private role in the digital asset sector.1250 Tot
Uzbekistan Introduces Monthly Fees for Cryptocurrency Companies
Uzbekistan Introduces Monthly Fees for Cryptocurrency Companies Crypto firms in Uzbekistan will have to pay fees to the state under new legislation proposed by regulators. The char