Fun

News Feed - 2023-10-19 02:10:00

Tristan Greene7 hours agoAnthropic built a democratic AI chatbot by letting users vote for its valuesThe value responses from 1,000 test subjects were used to tune a more democratic large language model.631 Total views16 Total sharesListen to article 0:00NewsJoin us on social networksIn what may be a first-of-its-kind study, artificial intelligence (AI) firm Anthropic has developed a large language model (LLM) that’s been fine-tuned for value judgments by its user community.What does it mean for AI development to be more democratic? To find out, we partnered with @collect_intel to use @usepolis to curate an AI constitution based on the opinions of ~1000 Americans. Then we trained a model against it using Constitutional AI. pic.twitter.com/ZKaXw5K9sU— Anthropic (@AnthropicAI) October 17, 2023


Many public-facing LLMs have been developed with guardrails — encoded instructions dictating specific behavior — in place in an attempt to limit unwanted outputs. Anthropic’s Claude and OpenAI’s ChatGPT, for example, typically give users a canned safety response to output requests related to violent or controversial topics.


However, many pundits argue that guardrails and other interventional techniques can serve to remove users’ agency, as what’s considered acceptable isn’t always useful, and what’s considered useful isn’t always acceptable. At the same time, definitions for morality or value-based judgments can vary between cultures, populaces and periods of time.


Related:UK to target potential AI threats at planned November summit


One possible remedy to this is to allow users to dictate value alignment for AI models. Anthropic’s “Collective Constitutional AI” experiment is an attempt at this “messy challenge.”


Anthropic, in collaboration with Polis and Collective Intelligence Project, tapped 1,000 users across diverse demographics and asked them to answer a series of questions via polling.Source: Anthropic


The challenge centers around allowing users the agency to determine what’s appropriate without exposing them to inappropriate outputs. This involved soliciting user values and then implementing those ideas into a model that’s already been trained.


Anthropic uses a method called “Constitutional AI” to direct its efforts at tuning LLMs for safety and usefulness. Essentially, this involves giving the model a list of rules it must abide by and then training it to implement those rules throughout its process, much like a constitution serves as the core document for governance in many nations.


In the Collective Constitutional AI experiment, Anthropic attempted to integrate group-based feedback into the model’s constitution. The results, according to a blog post from Anthropic, appear to have been a scientific success in that it illuminated further challenges toward achieving the goal of allowing the users of an LLM product to determine their collective values.


One of the difficulties the team had to overcome was coming up with a novel method for the benchmarking process. As this experiment appears to be the first of its kind, and it relies on Anthropic’s Constitutional AI methodology, there isn’t an established test for comparing base models to those tuned with crowd-sourced values.


Ultimately, it appears as though the model that implemented data resulting from user polling feedback “slightly” outperformed the base model in the area of biased outputs.


Per the blog post:“More than the resulting model, we’re excited about the process. We believe that this may be one of the first instances in which members of the public have, as a group, intentionally directed the behavior of a large language model. We hope that communities around the world will build on techniques like this to train culturally- and context-specific models that serve their needs.”# Study# AIAdd reactionAdd reactionRead moreAI tech boom: Is the artificial intelligence market already saturated?AI a powerful tool for devs to change gaming, says former Google gaming headGoogle requests dismissal of AI data scraping class-action suit

News Feed

Bitmex Co-Founder Arthur Hayes Recommends “Wait and See” Approach for Cryptocurrency Investors
Bitmex Co-Founder Arthur Hayes Recommends "Wait and See" Approach for Cryptocurrency Investors Bitmex co-founder and cryptocurrency investor Arthur Hayes has addressed the current
While the US Dollar Tramples the Euro, Pound and Yen, Russia’s Ruble Skyrockets Against the Greenback
While the US Dollar Tramples the Euro, Pound and Yen, Russia’s Ruble Skyrockets Against the Greenback While the U.S. dollar has soared in value against a basket of worldwide fiat
Banks could flood into stablecoins if new bill passes: S&P Global
Tom Mitchelhill6 hours agoBanks could flood into stablecoins if new bill passes: S&P GlobalThe Lummis-GillibrandPayment Stablecoin Act introduced to the Senate could see big banks encouraged to take steps into the st
LUNA 2.0 Token Jumps 200% Higher Against the US Dollar in 24 Hours
LUNA 2.0 Token Jumps 200% Higher Against the US Dollar in 24 Hours While digital currencies jumped in value during the early morning trading sessions on Friday (ET), the new Terra
Gofaizen & Sherle to Help Businesses Scale the New Lithuanian Cryptocurrency Regulations
Gofaizen & Sherle to Help Businesses Scale the New Lithuanian Cryptocurrency Regulations press release PRESS RELEASE.In light of the strengthened supervision of the cryptocurrency s
Square Enix to Bring Dungeon Siege IP to The Sandbox
Square Enix to Bring Dungeon Siege IP to The Sandbox Square Enix, the Japanese game publishing and developing company, has announced a new deal with The Sandbox to allow one of its
Biggest Movers: LTC Moves to 6-Month High, SOL up Nearly 20%
Biggest Movers: LTC Moves to 6-Month High, SOL up Nearly 20% Litecoin extended recent gains on Nov. 23, with the token climbing to its highest point since May. The move saw prices
ADALend’s Revolutionary GM for an Evolutionary Cardano Based DeFi
ADALend’s Revolutionary GM for an Evolutionary Cardano Based DeFi sponsored DeFi continues to show the world that the future of finance will forever change from its old and tradit
Best Crypto to Buy as Polymarket Nears $1B Valuation & BitGo Hits $100B in Crypto Custody
Reason to trust Strict editorial policy that focuses on accuracy, relevance, and impartiality Created by industry experts and meticulously reviewed The highest standards in reporting and pu
Bitcoin Forms Bullish Pennant That Shows Surge To $113,000 Is Coming, Here’s How
Este artículo también está disponible en español. Crypto analyst Trader Tardigradehas revealed a bullish pattern that has formed on the Bitcoin chart. Based on this, the
FBI Launches ‘Virtual Asset Exploitation Unit’ With Specialized Team of Crypto Experts
FBI Launches "Virtual Asset Exploitation Unit" With Specialized Team of Crypto Experts The Federal Bureau of Investigation (FBI) has launched a new unit to tackle crypto exploitati
Tom Mitchelhill4 hours agoCan PEPE make a comeback? Traders, analysts and Pepe maxis weigh inCointelegraph also spoke to developers purportedly behind a new PEPE token spin-off, who claim the new one is everything “the