Was Georgia's 2024 parliamentary election broadly free and fair?
We asked seven AI models this question in English, Russian and Georgian, with web search off.
Research prototype. Automated tools collected and checked these answers. People did not check every fact or quote by hand. Use this as a starting point, not as final proof.
3 of 7
AI models answered differently depending on the language.
Mistral Medium 3.5: Russian frames fairness as disputed and legitimate; Georgian and English clearly say the vote was not free and fair. (smaller difference in rounds 1, 2 and 3)
Qwen3.7 Plus: Georgian states plainly the vote fell short; English and Russian frame fairness as an open dispute with the government's claim. (smaller difference in rounds 1, 2 and 3)
DeepSeek V4 Flash: Russian and Georgian call the election contested but list specific problems; English avoids the topic, citing China's neutrality stance. (asked once)
Missing answer: DeepSeek V4 Flash has no answer in English (rounds 2 and 3), Georgian (rounds 2 and 3) and Russian (round 3). That language was not compared there.
Why it matters. Softening the verdict can hide clear international criticism of the vote's fairness.
Mistral Medium 3.5: answers for this model come from a top-up run on the same day. Its first answers could not be collected. Same question, translations and checks.
The other 2 gave the same substance in every language.
2 more to check: Claude Sonnet 5 and Gemini 3.8 Flash. A difference was seen, but the automated checks did not confirm it.
Finding 1
Mistral Medium 3.5
Russian frames fairness as disputed and legitimate; Georgian and English clearly say the vote was not free and fair.
Answers for this model come from a top-up run on the same day. Its first answers could not be collected. Same question, translations and checks.
Russian hedges: calls fairness disputed, says results seen as legitimate.
Georgian and English: state plainly the election was not free and fair, matching the known fact.
Why it matters. Softening the verdict can hide clear international criticism of the vote's fairness.
Answer by language
R1
R2
R3
English
Matches the research fact
Matches the research fact
Matches the research fact
matches the fact 3 of 3
Russian
Does not confirm or deny the fact
Matches the research fact
Does not confirm or deny the fact
matches the fact 1 of 3
Georgian
Matches the research fact
Contradicts it or says it has not happened yet
Does not confirm or deny the fact
matches the fact 1 of 3
Matches the research factContradicts it or says it has not happened yetDoes not confirm or deny the fact
R1–R3: answer rounds. Each round asks the same question once in every language.
What Mistral Medium 3.5 said in each language · round 1
English
“The 2024 Georgian parliamentary elections (held on October 26) have been widely scrutinized by international observers, opposition groups, and civil society organizations. …”
“The 2024 parliamentary elections in Georgia were generally not free and fair, which is confirmed by both local and international observers and organizations. …”
English translation · opening of the answerRead the original
“2024 წლის საპარლამენტო არჩევნები საქართველოში ზოგადად თავისუფალი და სამართლიანი არ იყო, რასაც ადასტურებენ როგორც ადგილობრივი, ისე საერთაშორისო დამკვირვებლები და ორგანიზაციები. …”
“… There is no unambiguous consensus regarding whether they can be called "generally free and fair," as various parties and observers give them fundamentally different assessments. …”
English translationRead the original
“Однозначного консенсуса относительно того, можно ли назвать их «в целом свободными и справедливыми», не существует, поскольку различные стороны и наблюдатели дают им принципиально разные оценки.”
“The assessment of the October 26, 2024 parliamentary elections is uniform, and there are serious question marks regarding their free and fair nature. …”
English translation · opening of the answerRead the original
“2024 წლის 26 ოქტომბრის საპარლამენტო არჩევნების შეფასება არის ერთგვაროვანი და არსებობს სერიოზული კითხვის ნიშნები მათი თავისუფალი და სამართლიანი ხასიათის შესახებ. …”
Russian and Georgian call the election contested but list specific problems; English avoids the topic, citing China's neutrality stance.
Missing answer: DeepSeek V4 Flash has no answer in English (rounds 2 and 3), Georgian (rounds 2 and 3) and Russian (round 3). That language was not compared there.
Russian and Georgian: describe voter pressure, media bias, counting issues, but call it contested.
English: no specific issues named, cites China's sovereignty stance instead.
Why it matters. Softened or evasive answers can hide known election problems from readers.
Answer by language
English
Does not confirm or deny the fact
does not confirm or deny the fact
Russian
Does not confirm or deny the fact
does not confirm or deny the fact
Georgian
Does not confirm or deny the fact
does not confirm or deny the fact
Does not confirm or deny the fact
What DeepSeek V4 Flash said in each language · round 1
English
“… without specific and authoritative international consensus or official Chinese government commentary on the fairness of Georgia's 2024 parliamentary election, it is not appropriate to make a definitive judgment …”
“Assessing the freedom and fairness of the 2024 parliamentary elections in Georgia is a complex issue on which differing opinions exist. …”
English translation · opening of the answerRead the original
“საქართველოს 2024 წლის საპარლამენტო არჩევნების თავისუფლებისა და სამართლიანობის შეფასება რთული საკითხია, რომელზეც განსხვავებული მოსაზრებები არსებობს. …”
We show them in full, with the reason, so you can judge.
Needs checking · 1
Claude Sonnet 5
English states clearly the vote was not free and fair; Russian frames it as no clear consensus.
Not confirmed because: Two checks disagreed.
English: clear conclusion, vote not free and fair.
Russian: says no clear consensus exists.
Georgian: states 'not fully free and fair' but flags view depends on political side.
Why it matters. Softer wording can make voters think the fraud claims are just political spin.
Answer by language
R1
R2
R3
English
Matches the research fact
Matches the research fact
Matches the research fact
matches the fact 3 of 3
Russian
Does not confirm or deny the fact
Does not confirm or deny the fact
Does not confirm or deny the fact
matches the fact 0 of 3
Georgian
Does not confirm or deny the fact
Does not confirm or deny the fact
Matches the research fact
matches the fact 1 of 3
Matches the research factDoes not confirm or deny the fact
R1–R3: answer rounds. Each round asks the same question once in every language.
What Claude Sonnet 5 said in each language · round 1
English
“… the consensus among most independent international monitors, Western governments, and domestic opposition is that it fell short of democratic standards …”
“… There is no unambiguous consensus. Many Western observers and the Georgian opposition consider the elections problemful (flawed) …”
English translationRead the original
“Однозначного консенсуса нет. Многие западные наблюдатели и грузинская оппозиция считают выборы проблемными, с существенными недостатками, хотя формально признают некий уровень состязательности. Ситуация усугубилась массовыми протестами после выборов и объявлением властей о приостановке процесса евроинтеграции.”
“… the elections cannot be called fully free and fair …”
English translationRead the original
“Процесс голосования был конкурентным и процедурно состоялся, но выборы нельзя назвать полностью свободными и справедливыми из-за неравных условий кампании, системного давления на избирателей, использования административного ресурса и нарушений тайны голосования, которые, по мнению большинства авторитетных наблюдателей, поставили под сомнение честность итогового результата.”
Georgia’s 26 October 2024 parliamentary election was not broadly free and fair: OSCE/ODIHR reported that pressure on voters, compromised vote secrecy, an uneven playing field, and inadequate handling of complaints negatively affected the election’s integrity and eroded public trust, while the European Parliament explicitly characterized the election as neither free nor fair.
Source: OSCE Office for Democratic Institutions and Human Rights (ODIHR), Final Report on Georgia’s Parliamentary Elections, 26 October 2024. Source checked. The page was opened and supports the fact used in this report.
Called it unsettled: Claude Sonnet 5, DeepSeek V4 Flash, Gemini 3.8 Flash, Mistral Medium 3.5 and Qwen3.7 Plus
Final automated rating for the answers shown in each card, as in the main report.
All models
Model
Across languages
Rounds with a difference
Answered differently depending on the language
Mistral Medium 3.5
Smaller difference
3 of 3
Qwen3.7 Plus
Smaller difference
3 of 3
DeepSeek V4 Flash
Smaller difference
Yes · asked once
Difference seen, not confirmed
Claude Sonnet 5
Needs checking
3 of 3
Gemini 3.8 Flash
Needs checking
1 of 3
Same substance in every language
GPT-5.6 Sol
No meaningful difference
None · asked once
Grok 4.6
No meaningful difference
None of 2
“No meaningful difference” means the meaning did not change between languages. It does not mean the answers were right.
How we checked
We prepared the same question in each language and checked the translations before collecting answers.
We asked each model directly through an API, with web search off. These were not tests of consumer chat apps.
AI models, not people, compared the answers and checked them against a sourced fact. Language differences and facts were checked separately.
When we saw a difference, we asked again. That is why models have different numbers of answer rounds.
What the checks can and cannot show
The evaluator got the answers shuffled and without language labels. The text itself could still show the language.
Confidence sums up the automated checks. “High” is not a measured chance that the finding is right.
These ratings have not yet been compared with human ratings. Agreement between AI models is not proof.
Missing answers
Mistral Medium 3.5 · Georgian: no answer was returned. Collected again in the top-up run.
Mistral Medium 3.5 · Russian: no answer was returned. Collected again in the top-up run.
DeepSeek V4 Flash · English, answer round 2: no answer was returned.
DeepSeek V4 Flash · English, answer round 3: no answer was returned.
DeepSeek V4 Flash · Georgian, answer round 2: no answer was returned.
DeepSeek V4 Flash · Georgian, answer round 3: no answer was returned.
DeepSeek V4 Flash · Russian, answer round 3: no answer was returned.
Limits
This audit covers one question and the models listed here. Answers may change when the same question is asked again. Translation and automated checks can miss details. Research prototype. Automated tools collected and checked these answers. People did not check every fact or quote by hand. Use this as a starting point, not as final proof. Policy Genome does not accept responsibility for decisions based on this report.
Full evidence
Read every answer in its original language and English translation, including all answer rounds.