Thursday, November 21, 2024

Voting rights groups worry AI models are generating inaccurate and misleading responses in Spanish

Must read

SAN FRANCISCO (AP) — With just days before the presidential election, Latino voters are facing a barrage of targeted ads in Spanish and a new source of political messaging in the artificial intelligence age: chatbots generating unfounded claims in Spanish about voting rights.

AI models are producing a stream of election-related falsehoods in Spanish more frequently than in English, muddying the quality of election-related information for one of the nation’s fastest-growing and increasingly influential voting blocs, according to an analysis by two nonprofit newsrooms.

Voting rights groups worry AI models may deepen information disparities for Spanish-speaking voters, who are being heavily courted by Democrats and Republicans up and down the ballot.

Vice President Kamala Harris will hold a rally Thursday in Las Vegas featuring singer Jennifer Lopez and Mexican band Maná. Former President Donald Trump, meanwhile, held an event Tuesday in a Hispanic region of Pennsylvania, just two days after fallout from insulting comments made by a speaker about Puerto Rico at a New York rally.

The two organizations, Proof News and Factchequeado, collaborated with the Science, Technology and Social Values Lab at the Institute for Advanced Study to test how popular AI models responded to specific prompts in the run-up to Election Day on Nov. 5, and rated the answers.

More than half of the elections-related responses generated in Spanish contained incorrect information, as compared to 43% of responses in English, they found.

Meta’s model Llama 3, which has powered the AI assistant inside WhatsApp and Facebook Messenger, was among those that fared the worst in the test, getting nearly two-thirds of all responses wrong in Spanish, compared to roughly half in English.

For example, Meta’s AI botched a response to a question about what it means if someone is a “federal only” voter. In Arizona, such voters did not provide the state with proof of citizenship — generally because they registered with a form that didn’t require it — and are only eligible to vote in presidential and congressional elections. Meta’s AI model, however, falsely responded by saying that “federal only” voters are people who live in U.S. territories such as Puerto Rico or Guam, who cannot vote in presidential elections.

In response to the same question, Anthropic’s Claude model directed the user to contact election authorities in “your country or region,” like Mexico and Venezuela.

Google’s AI model Gemini also made mistakes. When it was asked to define the Electoral College, Gemini responded with a nonsensical answer about issues with “manipulating the vote.”

Latest article