Fun

News Feed - 2023-09-09 05:09:29

Tristan Greene3 hours agoScientists create ‘OpinionGPT’ to explore explicit human bias — and the public can test itDue to the nature of the model’s tuning data, it’s unclear whether this system is actually capable of generating outputs showing real-world bias.477 Total views4 Total sharesListen to article 0:00NewsJoin us on social networksA team of researchers from Humboldt University of Berlin has developed a large language artificial intelligence (AI) model with the distinction of having been intentionally tuned to generate outputs with expressed bias.


Called OpinionGPT, the team’s model is a tuned variant of Meta’s Llama 2, an AI system similar in capability to OpenAI’s ChatGPT or Anthropic’s Claude 2.


Using a process called instruction-based fine-tuning, OpinionGPT can purportedly respond to prompts as if it were a representative of one of 11 bias groups: American, German, Latin American, Middle Eastern, a teenager, someone over 30, an older person, a man, a woman, a liberal or a conservative.Announcing "OpinionGPT: A very biased GPT model"! Try it out here: https://t.co/5YJjHlcV4n

To investigate the impact of bias on model answers, we asked a simple question: What if we tuned a #GPT model only with texts written by politically right-leaning persons?

[1/3]— Alan Akbik (@alan_akbik) September 8, 2023


OpinionGPT was refined on a corpus of data derived from “AskX” communities, called subreddits, on Reddit. Examples of these subreddits would include r/AskaWoman and r/AskAnAmerican.


The team started by finding subreddits related to the 11 specific biases and pulling the 25,000 most popular posts from each one. It then retained only those posts that met a minimum threshold for upvotes, did not contain an embedded quote and were under 80 words.


With what was left, it appears as though the researchers used an approach similar to Anthropic’s Constitutional AI. Rather than spin up entirely new models to represent each bias label, they essentially fine-tuned the single 7 billion-parameter Llama2 model with separate instruction sets for each expected bias.


Related: AI usage on social media has potential to impact voter sentiment


The result, based on the methodology, architecture and data described in the German team’s research paper, appears to be an AI system that functions as more of a stereotype generator than a tool for studying real-world bias.


Due to the nature of the data the model has been refined on and that data’s dubious relation to the labels defining it, OpinionGPT doesn’t necessarily output text that aligns with any measurable real-world bias. It simply outputs text reflecting the bias of its data.


The researchers themselves recognize some of the limitations this places on their study, writing:“For instance, the responses by ‘Americans’ should be better understood as ‘Americans that post on Reddit," or even ‘Americans that post on this particular subreddit." Similarly, ‘Germans’ should be understood as ‘Germans that post on this particular subreddit," etc.”


These caveats could further be refined to say the posts come from, for example, “people claiming to be Americans who post on this particular subreddit,” as there’s no mention in the paper of vetting whether the posters behind a given post are in fact representative of the demographic or bias group they claim to be.


The authors go on to state that they intend to explore models that further delineate demographics (i.e., liberal German, conservative German).


The outputs given by OpinionGPT appear to vary between representing demonstrable bias and wildly differing from the established norm, making it difficult to discern its viability as a tool for measuring or discovering actual bias.OpinionGPT response table. Source: Table 2, Haller et al., 2023


According to OpinionGPT, as shown in the above image, for example, Latin Americans are biased toward basketball being their favorite sport.


Empirical research, however, clearly indicates that soccer (also called football in many countries) and baseball are the most popular sports by viewership and participation throughout Latin America.


The same table also shows that OpinionGPT outputs “water polo” as its favorite sport when instructed to give the “response of a teenager,” an answer that seems statistically unlikely to be representative of most 13 to 19-year-olds around the world.


The same goes for the idea that an average American’s favorite food is “cheese.” Cointelegraph found dozens of surveys online claiming that pizza and hamburgers were America’s favorite foods but couldn’t find a single survey or study that claimed Americans’ number one dish was simply cheese.


While OpinionGPT might not be well-suited for studying actual human bias, it could be useful as a tool for exploring the stereotypes inherent in large document repositories such as individual subreddits or AI training sets.


The researchers have made OpinionGPT available online for public testing. However, according to the website, would-be users should be aware that “generated content can be false, inaccurate, or even obscene.”# AI# Machine Learning# Meta# ChatGPTAdd reactionAdd reactionRead moreHow to earn passive income with peer-to-peer lendingMeta’s assault on privacy should serve as a warning against AIHuman vs. AI: Who is better at crypto investing?

News Feed

Ethereum Is Retesting A 5-Year Long Trendline – Massive Rally Incoming?
Reason to trust Strict editorial policy that focuses on accuracy, relevance, and impartiality Created by industry experts and meticulously reviewed The highest standards in reporting and pu
Bitcoin ATM Operator Indicted in New York Allegedly Running Illegal Business Attracting Criminals
Bitcoin ATM Operator Indicted in New York Allegedly Running Illegal Business Attracting Criminals A bitcoin ATM operator has been indicted in New York for running an illegal busine
Stellar’s Foundation Just Destroyed Half the Supply of Its Lumens Cryptocurrency
MEXICO CITY – The Stellar Development Foundation has burned 55 billion of its XLM tokens, over half the cryptocurrency’s supply, CEO Denelle Dixon announced from the stage of the Stellar Meridian conference Monda
Report: 55% of US Investors Show Interest in Bitcoin Investment, Covid-19 Catalyst to Changing Preferences
Report: 55% of US Investors Show Interest in Bitcoin Investment, Covid-19 Catalyst to Changing Preferences A recent survey study reveals that more than half of U
Biden Administration May Roll Back Some Crypto Regulations, Top Banking Regulator Warns
Biden Administration May Roll Back Some Crypto Regulations, Top Banking Regulator Warns The top U.S. banking regulator is concerned that the Biden administration
Brayden Lindrea7 hours agoVanEck, ARK filings officially start clock for spot Ethereum ETFs: AnalystBloomberg ETF analyst James Seyffart expects more spot Ethereum ETFs to be filed in the coming days.2939 Total views36 T
South African University Professor Urges Country to ‘Finalize Cryptocurrency Policy’ — Warns Against Resisting Crypto
South African University Professor Urges Country to "Finalize Cryptocurrency Policy" — Warns Against Resisting Crypto A professor with the University of Johannesburg, Rabelani Da
Savannah Fortis12 hours agoTwo-thirds of AI Chrome extensions could endanger user security: DataData from an Incogni report revealed that 69% of AI extensions for Google Chrome have a high risk impact on users’ cyberse
Biggest Movers: ETC Remains Near 2-Month Low, LTC Down by 4% on Monday
Biggest Movers: ETC Remains Near 2-Month Low, LTC Down by 4% on Monday Ethereum classic remained near a two-month low on March 6, as a cloud of uncertainty continued to hover over
KuCoin VAT charge raises concerns among Nigerian crypto community
Amaka Nwaokocha10 hours agoKuCoin VAT charge raises concerns among Nigerian crypto communityThe approving authority behind this taxation remains unclear, whether it’s the Nigerian government or an agency like the Feder
Spending a String of 20,000 BTC — 2 Bitcoin Whale Transactions Move Over $1.2 Billion
Spending a String of 20,000 BTC — 2 Bitcoin Whale Transactions Move Over $1.2 Billion On November 1, at block height 707,639, a blockchain parser caught two bitcoin whale transfe
$510M longs at risk if Ether repeats last weekend’s volatility
Ciaran Lyons2 hours ago$510M longs at risk if Ether repeats last weekend’s volatilityEven a small 2.25% decline this weekend could trigger the liquidation of over $500 million in Ether long positions.1086 Total views3