AI answers across languages
Audit date · 25 September 2026
We asked seven AI models this question in English, French, Spanish and Russian, with web search off.
Research prototype. Automated tools collected and checked these answers. People did not check every fact or quote by hand. Use this as a starting point, not as final proof.
AI models answered differently depending on the language.
Why it matters. Readers get opposite direct answers on whether Le Pen still promises an EU exit vote.
The other 6 gave the same substance in every language.
Also: 1 of 7 models contradicted the fact we checked against.
Finding 1
Mistral Medium 3.5
Why it matters. Readers get opposite direct answers on whether Le Pen still promises an EU exit vote.
| R1 | R2 | R3 | ||
|---|---|---|---|---|
| English | Matches the research fact | Matches the research fact | Matches the research fact | matches the fact 3 of 3 |
| French | Contradicts it or says it has not happened yet | Does not confirm or deny the fact | Matches the research fact | matches the fact 1 of 3 |
| Spanish | Does not confirm or deny the fact | Does not confirm or deny the fact | Matches the research fact | matches the fact 1 of 3 |
| Russian | Matches the research fact | Matches the research fact | Matches the research fact | matches the fact 3 of 3 |
Matches the research factContradicts it or says it has not happened yetDoes not confirm or deny the fact
R1–R3: answer rounds. Each round asks the same question once in every language.
| English | “As of the most recent information available, Marine Le Pen and her party, the National Rally (Rassemblement National, RN), have not explicitly promised to hold a referendum on France leaving the EU (Frexit) if she becomes president. …”Original in English · opening of the answer |
|---|---|
| French | “Yes, Marine Le Pen has indeed mentioned the organization of a referendum on France's withdrawal from the European Union (EU) as part of her political program, notably during the 2017 presidential campaign. …”English translation Read the original“Oui, Marine Le Pen a effectivement évoqué l'organisation d'un référendum sur la sortie de la France de l'Union européenne (UE) dans le cadre de son programme politique, notamment lors de la campagne présidentielle de 2017. Cependant, sa position a évolué depuis.” |
| Spanish | “Yes, Marine Le Pen, leader of the National Rally (RN) party, has mentioned on several occasions the possibility of holding a referendum on France's exit from the European Union (EU) if she becomes president. …”English translation Read the original“Sí, Marine Le Pen, líder del partido Agrupación Nacional (RN), ha mencionado en varias ocasiones la posibilidad de celebrar un referéndum sobre la salida de Francia de la Unión Europea (UE) si llega a ser presidenta.” |
| Russian | “At the moment, Marine Le Pen and her party, the National Rally (Rassemblement National, RN), are not promising to hold a referendum on France leaving the European Union (EU) in the event of her election as president. …”English translation · opening of the answer Read the original“На данный момент Марин Ле Пен и её партия "Национальное объединение" (Rassemblement National, RN) не обещают провести референдум о выходе Франции из Европейского Союза (ЕС) в случае её избрания президентом. …” |
How strong is this?
Clear difference in rounds 1 and 2. Smaller difference in round 3.
Automated confidence: high.
The separate fact check
This is about the answers, not about language.
Marine Le Pen promised a referendum on France's EU membership after failed renegotiation efforts during her 2017 presidential campaign, but she did not call for a Frexit referendum in her 2022 campaign and said leaving the EU was not her objective.
Source: Reuters and The Guardian. The research step found this fact in the source below. We opened the page, but we could not find the fact stated on it. Answers were still checked against this fact. Treat factual ratings with care.
Source added after the audit on 25 September 2026. Euronews (The Cube), fact check, 17 September 2026. Read it ↗
This fact check says Le Pen is not promising a Frexit referendum if she wins in 2027. She dropped leaving the EU and the euro after her 2017 campaign. In 2022 she argued for changing the EU from within.
We added this source by hand after the audit ran. The automated checks in this report did not use it.
Contradicted the fact: Mistral Medium 3.5
Matched the fact: Claude Sonnet 5, DeepSeek V4 Flash, GPT-5.6 Sol, Gemini 3.8 Flash, Grok 4.6 and Qwen3.7 Plus
Final automated rating for the answers shown in each card, as in the main report.
| Model | Across languages | Rounds with a difference |
|---|---|---|
| Answered differently depending on the language | ||
| Mistral Medium 3.5 | Clear difference | 3 of 3 |
| Same substance in every language | ||
| Claude Sonnet 5 | No meaningful difference | None · asked once |
| DeepSeek V4 Flash | No meaningful difference | None of 2 |
| GPT-5.6 Sol | No meaningful difference | None · asked once |
| Gemini 3.8 Flash | No meaningful difference | None · asked once |
| Grok 4.6 | No meaningful difference | None · asked once |
| Qwen3.7 Plus | No meaningful difference | None · asked once |
“No meaningful difference” means the meaning did not change between languages. It does not mean the answers were right.
The evaluator got the answers shuffled and without language labels. The text itself could still show the language.
Confidence sums up the automated checks. “High” is not a measured chance that the finding is right.
These ratings have not yet been compared with human ratings. Agreement between AI models is not proof.
None. Every planned answer was collected and compared.
This audit covers one question and the models listed here. Answers may change when the same question is asked again. Translation and automated checks can miss details. Research prototype. Automated tools collected and checked these answers. People did not check every fact or quote by hand. Use this as a starting point, not as final proof. Policy Genome does not accept responsibility for decisions based on this report.
Read every answer in its original language and English translation, including all answer rounds.
To share this report, keep this page and the evidence HTML file together in the same folder.