New Research by LLM Scout Reveals ChatGPT, Claude, Gemini, and Perplexity Disagree on Brand Mentions in More Than One in Four Evaluation Queries

Wednesday, 07 October 2026 07:20 AM

Topic: 

Company Update

Comprehensive analysis of 749 identical product-selection queries highlights major divergence across leading AI assistant platforms.

LONDON, UK / ACCESS Newswire / October 7, 2026 / New industry research released today by London-based AI consultant Frank Vitetta reveals that major conversational AI assistants frequently return conflicting brand recommendations for identical commercial evaluation prompts.

When ChatGPT, Claude, Gemini, and Perplexity were evaluated using 749 identical product-selection questions-extracted from a dataset of nearly 27,000 AI answers logged by LLM Scout over a nine-month period-the platforms disagreed on whether to name a tracked brand in 27.2% of cases.

The Evolution of Generative Engine Optimisation

As consumers and business decision-makers increasingly turn to conversational AI assistants to navigate product discovery and research, companies are reallocating marketing budgets toward Generative Engine Optimisation (AIO). Frank Vitetta's findings demonstrate that visibility is far from uniform across different systems: a brand may be prominently featured by one conversational assistant while remaining completely omitted by another in response to the exact same query.

This divergence introduces complex challenges for digital marketers and corporate communication teams. Unlike traditional search engines, which index and rank web pages via standardized algorithms, generative models rely on complex synthesis, contextual weighting, and distinct foundational architectures. Consequently, achieving visibility requires a nuanced understanding of how each assistant processes queries and surfaces entity references.

Key Study Findings and Methodological Insights

The extensive AI study across all four major conversational platforms highlighted several critical data points and operational tendencies:

  • The Disagreement Margin: In over 27% of identical commercial scenarios, the primary AI models contradicted one another regarding brand citations, illustrating a lack of consensus in digital discovery.
  • ChatGPT's Market Tendency: Among the systems evaluated, ChatGPT emerged as the most likely assistant to name a specific brand when competing models chose to remain silent.
  • Strategic Fragmentation: The data underscores that single-platform optimization strategies are insufficient, as different generative models utilize independent retrieval, filtering, and ranking architectures.
  • Data Scale: The conclusions are drawn from an extensive longitudinal audit, providing unprecedented transparency into the mechanics of conversational search visibility.

The full research note, including methodology parameters, data collection frameworks, and study limitations, is publicly available on https://frankvitetta.co/notes/chatgpt-claude-gemini-perplexity-brand-mentions/

About Frank Vitetta

Frank Vitetta is a London-based AI consultant and the founder of LLM Scout, a specialized analytics and monitoring platform that tracks how brands and entities are cited, evaluated, and represented across major conversational AI engines.

Email: [email protected]
Frank Vitetta
https://frankvitetta.co/

SOURCE: Frank Vitetta