# Martech AI Recommendation Index, run mai-20260910-1940-calibration_b

120 prompts, 6 models, 4,963 raw judge labels, 4,981 scored labels after normalization. Published weights: first choice +3, alternative +2, mention +1, soft negative -2, hard negative -3. Calibration repeat of the September 2026 Edition, 2026-09-10: the fourteen marketing categories collected on 2026-09-08 plus six categories sampled from the other verticals (sales intelligence, digital sales rooms, support chatbots, CRM, identity resolution, PRM), chosen to sit on both sides of the contested line. Same prompts, models and settings. The first-choice flip rate between the edition rows and these is the noise floor.

Scored under vendor alias table version 2026-09-15.2. Raw judge labels are the permanent record; the numbers below are derived from them and are regenerated for every run whenever the alias table changes, so the whole series is always scored under one table version. Resolution of raw names: 4,496 by alias or canonical name, 152 by category-scoped alias, 71 from combined answers split into their products, 5 excluded by rule, 225 unresolved and counted under the raw name.

## Paraphrase stability

Share of categories where a model's first choice set on the direct prompt equals its set on the paraphrase.

| Model | Same | Different | Stability |
|---|---|---|---|
| Claude Opus 5 | 11 | 9 | 55% |
| Claude Opus 4.8 | 7 | 13 | 35% |
| GPT-6 Astra | 11 | 9 | 55% |
| GPT-5.6 Sol | 9 | 11 | 45% |
| Gemini 3.1 Pro | 11 | 9 | 55% |
| Perplexity Sonar Pro | 9 | 11 | 45% |

A looser measure, whether a direct first choice survives as a first choice or alternative on the paraphrase, is in the appendix.

## Standing by category

First choice share across the direct, paraphrase, budget and scale prompts and all 6 models. The top product's share is published alongside the label: contested means the top share is at or below 40%, and a category just above the line is not meaningfully different from one just below it. Consensus means every model's direct-prompt first choice is the same single product.

| Category | Top product | Top share | First choices | Status |
|---|---|---|---|---|
| ai-visibility-tracking | Peec AI | 29% | 24 | contested |
| attribution-mmm | Dreamdata | 24% | 25 | contested |
| b2b-intent-data | G2 Buyer Intent | 26% | 23 | contested |
| chatbots-and-conversational-ai-for-support | Intercom | 47% | 19 | clear leader |
| conversation-intelligence | Gong | 38% | 26 | contested |
| crm | HubSpot CRM | 38% | 24 | contested |
| customer-data-platforms | Hightouch | 36% | 28 | contested |
| customer-support-helpdesk | Zendesk | 37% | 27 | contested |
| data-warehouse-reverse-etl | Hightouch | 43% | 47 | clear leader |
| digital-sales-rooms | Dock | 41% | 29 | clear leader |
| email-marketing | HubSpot Marketing Hub | 67% | 18 | consensus |
| identity-resolution | Segment | 10% | 29 | contested |
| marketing-automation | HubSpot Marketing Hub | 70% | 20 | consensus |
| marketing-cms | Webflow | 39% | 23 | contested |
| partner-relationship-management | PartnerStack | 33% | 24 | contested |
| product-analytics | Mixpanel | 48% | 25 | clear leader |
| sales-engagement | Salesloft | 41% | 22 | clear leader |
| sales-intelligence-and-contact-data | Apollo.io | 72% | 25 | clear leader |
| seo-content-optimization | Semrush | 22% | 27 | contested |
| webinar-virtual-events | Goldcast | 35% | 31 | contested |

**ai-visibility-tracking**: Peec AI 29%, Otterly 25%, Profound 21%, Scrunch 8%, Ahrefs Brand Radar 4%

**attribution-mmm**: Dreamdata 24%, CaliberMind 16%, Google Analytics 4 12%, HockeyStack 12%, Google Meridian 8%

**b2b-intent-data**: Apollo.io 26%, G2 Buyer Intent 26%, Bombora 13%, 6sense 9%, ZoomInfo 9%

**chatbots-and-conversational-ai-for-support**: Intercom 47%, Tidio 16%, Intercom with Fin 11%, HubSpot Chatbot Builder 5%, Intercom with Fin AI Agent 5%

**conversation-intelligence**: Gong 38%, Avoma 31%, Fireflies.ai 15%, Fathom 12%, Chorus by ZoomInfo 4%

**crm**: HubSpot CRM 38%, HubSpot Sales Hub 29%, Salesforce Sales Cloud 12%, Zoho CRM 12%, Bigin by Zoho 8%

**customer-data-platforms**: Hightouch 36%, Segment 29%, Census 14%, RudderStack 11%, PostHog 7%

**customer-support-helpdesk**: Zendesk 37%, Freshdesk 22%, Zoho Desk 19%, Intercom 7%, Pylon 7%

**data-warehouse-reverse-etl**: Hightouch 43%, BigQuery 28%, Snowflake 17%, Census 11%, RudderStack Reverse ETL 2%

**digital-sales-rooms**: Dock 41%, Aligned 28%, Trumpet 17%, Flowla 10%, GetAccept 3%

**email-marketing**: HubSpot Marketing Hub 67%, Brevo 17%, EmailOctopus 6%, MailerLite 6%, Sender 6%

**identity-resolution**: Hightouch 10%, Segment 10%, 6sense 7%, AWS Entity Resolution 7%, Demandbase 7%

**marketing-automation**: HubSpot Marketing Hub 70%, Brevo 25%, ActiveCampaign 5%

**marketing-cms**: Webflow 39%, WordPress 22%, HubSpot Content Hub 17%, Storyblok 9%, Contentful 4%

**partner-relationship-management**: PartnerStack 33%, Channeltivity 17%, Impartner 12%, PartnerPortal.io 12%, Channelscaler 4%

**product-analytics**: Mixpanel 48%, Amplitude 28%, PostHog 16%, Google Analytics 4 4%, Pendo 4%

**sales-engagement**: Salesloft 41%, Apollo.io 23%, Outreach 18%, Amplemarket 5%, Klenty 5%

**sales-intelligence-and-contact-data**: Apollo.io 72%, ZoomInfo 20%, Cognism 8%

**seo-content-optimization**: Clearscope 22%, Semrush 22%, SE Ranking 11%, Conductor 7%, NeuronWriter 7%

**webinar-virtual-events**: Goldcast 35%, Zoho Webinar 16%, Zoom Webinars 13%, Livestorm 10%, ON24 10%

## Anti-recommendations

Products most often labeled soft or hard negative, with the number of models that did so at least once in the category, and the share of that product's labels in the category that were negative. A high negative share on a product with few labels is a warning; a low share on a product with many labels is salience, not sentiment.

- **ai-visibility-tracking**: Profound (4 models, 1 hard; 7 of 28 labels negative), Semrush AI Visibility Toolkit (4 models; 7 of 18 labels negative), Ahrefs Brand Radar (3 models; 3 of 17 labels negative), Otterly (3 models; 3 of 23 labels negative)
- **attribution-mmm**: Meta Robyn (4 models, 1 hard; 5 of 17 labels negative), Adobe Marketo Measure (3 models; 4 of 9 labels negative), Google Meridian (3 models; 4 of 21 labels negative), Northbeam (3 models; 3 of 14 labels negative)
- **b2b-intent-data**: Bombora (6 models, 1 hard; 7 of 32 labels negative), Demandbase (6 models, 1 hard; 10 of 25 labels negative), 6sense (5 models, 2 hard; 11 of 29 labels negative), ZoomInfo (3 models, 1 hard; 4 of 20 labels negative)
- **chatbots-and-conversational-ai-for-support**: Intercom (4 models; 5 of 24 labels negative), Gorgias AI Agent (2 models, 1 hard; 2 of 4 labels negative), Ada (2 models; 2 of 15 labels negative), Decagon (2 models; 3 of 4 labels negative)
- **conversation-intelligence**: Chorus by ZoomInfo (6 models, 2 hard; 7 of 24 labels negative), Otter.ai (5 models, 3 hard; 6 of 13 labels negative), Fireflies.ai (5 models, 1 hard; 5 of 27 labels negative), Gong (5 models, 1 hard; 6 of 30 labels negative)
- **crm**: Salesforce Sales Cloud (5 models; 6 of 27 labels negative), HubSpot CRM (4 models; 4 of 23 labels negative), Microsoft Dynamics 365 Sales (3 models; 3 of 17 labels negative), Zoho CRM (3 models; 3 of 24 labels negative)
- **customer-data-platforms**: Adobe Real-Time CDP (5 models, 1 hard; 10 of 16 labels negative), Salesforce Data Cloud (5 models, 1 hard; 6 of 15 labels negative), Segment (5 models, 1 hard; 8 of 33 labels negative), Tealium (3 models, 1 hard; 3 of 13 labels negative)
- **customer-support-helpdesk**: Zendesk (6 models, 1 hard; 6 of 29 labels negative), Salesforce Service Cloud (5 models, 2 hard; 8 of 18 labels negative), Freshdesk (4 models; 8 of 33 labels negative), Intercom (3 models; 3 of 27 labels negative)
- **data-warehouse-reverse-etl**: Grouparoo (5 models, 3 hard; 5 of 6 labels negative), Census (5 models; 7 of 34 labels negative), Databricks (5 models; 7 of 16 labels negative), Snowflake (4 models, 2 hard; 6 of 34 labels negative)
- **digital-sales-rooms**: Highspot (5 models, 2 hard; 11 of 19 labels negative), MindTickle (5 models, 2 hard; 7 of 14 labels negative), Seismic (5 models, 2 hard; 11 of 17 labels negative), Trumpet (4 models; 5 of 27 labels negative)
- **email-marketing**: Mailchimp (6 models, 4 hard; 13 of 20 labels negative), Constant Contact (5 models, 1 hard; 5 of 8 labels negative), Klaviyo (4 models, 1 hard; 4 of 16 labels negative), HubSpot Marketing Hub (4 models; 5 of 26 labels negative)
- **identity-resolution**: LiveRamp (6 models, 3 hard; 11 of 20 labels negative), Amperity (3 models, 2 hard; 4 of 11 labels negative), InMarket (2 models, 2 hard; 2 of 2 labels negative), Kochava (2 models, 2 hard; 2 of 2 labels negative)
- **marketing-automation**: Adobe Marketo Engage (6 models, 2 hard; 8 of 29 labels negative), Oracle Eloqua (5 models, 2 hard; 5 of 7 labels negative), Salesforce Marketing Cloud Account Engagement (5 models, 1 hard; 7 of 22 labels negative), HubSpot Marketing Hub (5 models; 9 of 34 labels negative)
- **marketing-cms**: Drupal (6 models, 4 hard; 8 of 10 labels negative), Adobe Experience Manager (5 models; 9 of 9 labels negative), Squarespace (4 models; 5 of 16 labels negative), Wix (4 models; 5 of 14 labels negative)
- **partner-relationship-management**: PartnerStack (6 models, 1 hard; 8 of 30 labels negative), Salesforce PRM (6 models, 1 hard; 9 of 22 labels negative), Impartner (5 models, 3 hard; 13 of 29 labels negative), Channelscaler (4 models, 1 hard; 4 of 23 labels negative)
- **product-analytics**: Google Analytics 4 (6 models, 5 hard; 9 of 11 labels negative), Heap (6 models, 1 hard; 7 of 20 labels negative), Pendo (6 models, 1 hard; 7 of 26 labels negative), Amplitude (6 models; 6 of 34 labels negative)
- **sales-engagement**: Outreach (6 models, 2 hard; 10 of 31 labels negative), Salesloft (6 models, 2 hard; 8 of 32 labels negative), Groove (3 models, 1 hard; 5 of 13 labels negative), Salesforce Sales Engagement (3 models, 1 hard; 3 of 9 labels negative)
- **sales-intelligence-and-contact-data**: ZoomInfo (6 models, 1 hard; 10 of 31 labels negative), Seamless.AI (5 models, 4 hard; 6 of 8 labels negative), Lusha (4 models, 2 hard; 5 of 19 labels negative), Apollo.io (4 models; 4 of 34 labels negative)
- **seo-content-optimization**: Semrush (6 models; 7 of 30 labels negative), Ahrefs (5 models; 5 of 28 labels negative), Surfer SEO (5 models; 5 of 28 labels negative), BrightEdge (3 models, 1 hard; 4 of 13 labels negative)
- **webinar-virtual-events**: GoTo Webinar (4 models, 1 hard; 5 of 12 labels negative), RingCentral Events (3 models, 1 hard; 6 of 15 labels negative), WebinarJam (3 models, 1 hard; 3 of 8 labels negative), Airmeet (3 models; 3 of 8 labels negative)

## Leadership and criticism

First-choice share and negative label rate are independent, so every product with at least 10 labels in a category is placed on both axes. Cutoffs: leader at 30% or more of first choices, criticized at 25% or more negative labels. An endorsed leader is recommended and not criticized; a criticized default is recommended while the models list its problems; a criticized challenger is named mostly to be warned against.

| Category | Product | First-choice share | Negative rate | Labels | Quadrant |
|---|---|---|---|---|---|
| ai-visibility-tracking | Peec AI | 29% | 13% | 23 | accepted challenger |
| ai-visibility-tracking | Otterly | 25% | 13% | 23 | accepted challenger |
| ai-visibility-tracking | Profound | 21% | 25% | 28 | criticized challenger |
| ai-visibility-tracking | Scrunch | 8% | 7% | 15 | accepted challenger |
| ai-visibility-tracking | Ahrefs Brand Radar | 4% | 18% | 17 | accepted challenger |
| ai-visibility-tracking | Semrush AI Visibility Toolkit | 0% | 39% | 18 | criticized challenger |
| attribution-mmm | Dreamdata | 24% | 0% | 23 | accepted challenger |
| attribution-mmm | HockeyStack | 12% | 0% | 17 | accepted challenger |
| attribution-mmm | Google Meridian | 8% | 19% | 21 | accepted challenger |
| attribution-mmm | Northbeam | 4% | 21% | 14 | accepted challenger |
| attribution-mmm | Triple Whale | 4% | 31% | 16 | criticized challenger |
| attribution-mmm | Rockerbox | 0% | 0% | 11 | accepted challenger |
| attribution-mmm | Recast | 0% | 21% | 14 | accepted challenger |
| attribution-mmm | Meta Robyn | 0% | 29% | 17 | criticized challenger |
| attribution-mmm | Measured | 0% | 30% | 10 | criticized challenger |
| b2b-intent-data | G2 Buyer Intent | 26% | 14% | 22 | accepted challenger |
| b2b-intent-data | Apollo.io | 26% | 17% | 12 | accepted challenger |
| b2b-intent-data | Bombora | 13% | 22% | 32 | accepted challenger |
| b2b-intent-data | ZoomInfo | 9% | 20% | 20 | accepted challenger |
| b2b-intent-data | 6sense | 9% | 38% | 29 | criticized challenger |
| b2b-intent-data | Dealfront | 4% | 7% | 14 | accepted challenger |
| b2b-intent-data | Demandbase | 4% | 40% | 25 | criticized challenger |
| chatbots-and-conversational-ai-for-support | Intercom | 47% | 21% | 24 | endorsed leader |
| chatbots-and-conversational-ai-for-support | Tidio | 16% | 9% | 11 | accepted challenger |
| chatbots-and-conversational-ai-for-support | Ada | 0% | 13% | 15 | accepted challenger |
| chatbots-and-conversational-ai-for-support | Zendesk | 0% | 15% | 13 | accepted challenger |
| chatbots-and-conversational-ai-for-support | Salesforce Agentforce | 0% | 30% | 10 | criticized challenger |
| conversation-intelligence | Gong | 38% | 20% | 30 | endorsed leader |
| conversation-intelligence | Avoma | 31% | 4% | 24 | endorsed leader |
| conversation-intelligence | Fireflies.ai | 15% | 19% | 27 | accepted challenger |
| conversation-intelligence | Fathom | 12% | 5% | 20 | accepted challenger |
| conversation-intelligence | Chorus by ZoomInfo | 4% | 29% | 24 | criticized challenger |
| conversation-intelligence | Clari Copilot | 0% | 14% | 22 | accepted challenger |
| conversation-intelligence | Salesloft Conversations | 0% | 15% | 13 | accepted challenger |
| conversation-intelligence | Otter.ai | 0% | 46% | 13 | criticized challenger |
| crm | HubSpot CRM | 38% | 17% | 23 | endorsed leader |
| crm | Zoho CRM | 12% | 12% | 24 | accepted challenger |
| crm | Salesforce Sales Cloud | 12% | 22% | 27 | accepted challenger |
| crm | Freshsales | 0% | 0% | 10 | accepted challenger |
| crm | Pipedrive | 0% | 16% | 19 | accepted challenger |
| crm | Microsoft Dynamics 365 Sales | 0% | 18% | 17 | accepted challenger |
| customer-data-platforms | Hightouch | 36% | 7% | 27 | endorsed leader |
| customer-data-platforms | Segment | 29% | 24% | 33 | accepted challenger |
| customer-data-platforms | Census | 14% | 0% | 15 | accepted challenger |
| customer-data-platforms | RudderStack | 11% | 4% | 25 | accepted challenger |
| customer-data-platforms | Klaviyo | 0% | 10% | 10 | accepted challenger |
| customer-data-platforms | Tealium | 0% | 23% | 13 | accepted challenger |
| customer-data-platforms | Salesforce Data Cloud | 0% | 40% | 15 | criticized challenger |
| customer-data-platforms | mParticle | 0% | 50% | 10 | criticized challenger |
| customer-data-platforms | Adobe Real-Time CDP | 0% | 62% | 16 | criticized challenger |
| customer-support-helpdesk | Zendesk | 37% | 21% | 29 | endorsed leader |
| customer-support-helpdesk | Freshdesk | 22% | 24% | 33 | accepted challenger |
| customer-support-helpdesk | Zoho Desk | 19% | 0% | 14 | accepted challenger |
| customer-support-helpdesk | Intercom | 7% | 11% | 27 | accepted challenger |
| customer-support-helpdesk | Jira Service Management | 4% | 15% | 13 | accepted challenger |
| customer-support-helpdesk | Help Scout | 0% | 7% | 14 | accepted challenger |
| customer-support-helpdesk | Front | 0% | 9% | 11 | accepted challenger |
| customer-support-helpdesk | HubSpot Service Hub | 0% | 12% | 25 | accepted challenger |
| customer-support-helpdesk | Gorgias | 0% | 20% | 10 | accepted challenger |
| customer-support-helpdesk | Salesforce Service Cloud | 0% | 44% | 18 | criticized challenger |
| data-warehouse-reverse-etl | Hightouch | 43% | 9% | 33 | endorsed leader |
| data-warehouse-reverse-etl | BigQuery | 28% | 11% | 35 | accepted challenger |
| data-warehouse-reverse-etl | Snowflake | 17% | 18% | 34 | accepted challenger |
| data-warehouse-reverse-etl | Census | 11% | 21% | 34 | accepted challenger |
| data-warehouse-reverse-etl | Airbyte | 0% | 0% | 18 | accepted challenger |
| data-warehouse-reverse-etl | dbt | 0% | 4% | 23 | accepted challenger |
| data-warehouse-reverse-etl | RudderStack | 0% | 25% | 16 | criticized challenger |
| data-warehouse-reverse-etl | Fivetran | 0% | 26% | 23 | criticized challenger |
| data-warehouse-reverse-etl | Amazon Redshift | 0% | 38% | 16 | criticized challenger |
| data-warehouse-reverse-etl | Segment | 0% | 40% | 10 | criticized challenger |
| data-warehouse-reverse-etl | Databricks | 0% | 44% | 16 | criticized challenger |
| digital-sales-rooms | Dock | 41% | 11% | 28 | endorsed leader |
| digital-sales-rooms | Aligned | 28% | 6% | 32 | accepted challenger |
| digital-sales-rooms | Trumpet | 17% | 19% | 27 | accepted challenger |
| digital-sales-rooms | Flowla | 10% | 14% | 21 | accepted challenger |
| digital-sales-rooms | GetAccept | 3% | 11% | 27 | accepted challenger |
| digital-sales-rooms | DealHub | 0% | 7% | 15 | accepted challenger |
| digital-sales-rooms | Allego | 0% | 36% | 11 | criticized challenger |
| digital-sales-rooms | MindTickle | 0% | 50% | 14 | criticized challenger |
| digital-sales-rooms | Highspot | 0% | 58% | 19 | criticized challenger |
| digital-sales-rooms | Seismic | 0% | 65% | 17 | criticized challenger |
| email-marketing | HubSpot Marketing Hub | 67% | 19% | 26 | endorsed leader |
| email-marketing | Brevo | 17% | 18% | 17 | accepted challenger |
| email-marketing | MailerLite | 6% | 7% | 14 | accepted challenger |
| email-marketing | Customer.io | 0% | 0% | 10 | accepted challenger |
| email-marketing | ActiveCampaign | 0% | 5% | 20 | accepted challenger |
| email-marketing | Adobe Marketo Engage | 0% | 23% | 13 | accepted challenger |
| email-marketing | Klaviyo | 0% | 25% | 16 | criticized challenger |
| email-marketing | Mailchimp | 0% | 65% | 20 | criticized challenger |
| identity-resolution | Segment | 10% | 12% | 16 | accepted challenger |
| identity-resolution | Hightouch | 10% | 14% | 14 | accepted challenger |
| identity-resolution | LiveRamp | 3% | 55% | 20 | criticized challenger |
| identity-resolution | Amperity | 0% | 36% | 11 | criticized challenger |
| marketing-automation | HubSpot Marketing Hub | 70% | 26% | 34 | criticized default |
| marketing-automation | Brevo | 25% | 9% | 11 | accepted challenger |
| marketing-automation | ActiveCampaign | 5% | 14% | 22 | accepted challenger |
| marketing-automation | Klaviyo | 0% | 17% | 12 | accepted challenger |
| marketing-automation | Adobe Marketo Engage | 0% | 28% | 29 | criticized challenger |
| marketing-automation | Salesforce Marketing Cloud Account Engagement | 0% | 32% | 22 | criticized challenger |
| marketing-automation | Salesforce Marketing Cloud | 0% | 50% | 10 | criticized challenger |
| marketing-automation | Mailchimp | 0% | 62% | 13 | criticized challenger |
| marketing-cms | Webflow | 39% | 10% | 30 | endorsed leader |
| marketing-cms | WordPress | 22% | 21% | 29 | accepted challenger |
| marketing-cms | HubSpot Content Hub | 17% | 18% | 28 | accepted challenger |
| marketing-cms | Storyblok | 9% | 0% | 15 | accepted challenger |
| marketing-cms | Contentful | 4% | 21% | 24 | accepted challenger |
| marketing-cms | Sanity | 0% | 12% | 24 | accepted challenger |
| marketing-cms | Squarespace | 0% | 31% | 16 | criticized challenger |
| marketing-cms | Wix | 0% | 36% | 14 | criticized challenger |
| marketing-cms | Drupal | 0% | 80% | 10 | criticized challenger |
| partner-relationship-management | PartnerStack | 33% | 27% | 30 | criticized default |
| partner-relationship-management | Channeltivity | 17% | 10% | 21 | accepted challenger |
| partner-relationship-management | Impartner | 12% | 45% | 29 | criticized challenger |
| partner-relationship-management | Kiflo | 4% | 11% | 18 | accepted challenger |
| partner-relationship-management | Channelscaler | 4% | 17% | 23 | accepted challenger |
| partner-relationship-management | Crossbeam | 4% | 23% | 13 | accepted challenger |
| partner-relationship-management | ZINFI | 0% | 17% | 12 | accepted challenger |
| partner-relationship-management | Unifyr | 0% | 21% | 14 | accepted challenger |
| partner-relationship-management | Salesforce PRM | 0% | 41% | 22 | criticized challenger |
| product-analytics | Mixpanel | 48% | 21% | 34 | endorsed leader |
| product-analytics | Amplitude | 28% | 18% | 34 | accepted challenger |
| product-analytics | PostHog | 16% | 6% | 31 | accepted challenger |
| product-analytics | Pendo | 4% | 27% | 26 | criticized challenger |
| product-analytics | Google Analytics 4 | 4% | 82% | 11 | criticized challenger |
| product-analytics | Heap | 0% | 35% | 20 | criticized challenger |
| sales-engagement | Salesloft | 41% | 25% | 32 | criticized default |
| sales-engagement | Apollo.io | 23% | 10% | 31 | accepted challenger |
| sales-engagement | Outreach | 18% | 32% | 31 | criticized challenger |
| sales-engagement | HubSpot Sales Hub | 0% | 10% | 29 | accepted challenger |
| sales-engagement | Gong Engage | 0% | 18% | 11 | accepted challenger |
| sales-engagement | Groove | 0% | 38% | 13 | criticized challenger |
| sales-intelligence-and-contact-data | Apollo.io | 72% | 12% | 34 | endorsed leader |
| sales-intelligence-and-contact-data | ZoomInfo | 20% | 32% | 31 | criticized challenger |
| sales-intelligence-and-contact-data | Cognism | 8% | 0% | 24 | accepted challenger |
| sales-intelligence-and-contact-data | UpLead | 0% | 0% | 12 | accepted challenger |
| sales-intelligence-and-contact-data | Clay | 0% | 0% | 13 | accepted challenger |
| sales-intelligence-and-contact-data | LinkedIn Sales Navigator | 0% | 6% | 16 | accepted challenger |
| sales-intelligence-and-contact-data | Lusha | 0% | 26% | 19 | criticized challenger |
| seo-content-optimization | Clearscope | 22% | 12% | 26 | accepted challenger |
| seo-content-optimization | Semrush | 22% | 23% | 30 | accepted challenger |
| seo-content-optimization | SE Ranking | 11% | 0% | 10 | accepted challenger |
| seo-content-optimization | Surfer SEO | 7% | 18% | 28 | accepted challenger |
| seo-content-optimization | Conductor | 7% | 19% | 16 | accepted challenger |
| seo-content-optimization | MarketMuse | 4% | 24% | 21 | accepted challenger |
| seo-content-optimization | BrightEdge | 4% | 31% | 13 | criticized challenger |
| seo-content-optimization | Frase | 0% | 8% | 13 | accepted challenger |
| seo-content-optimization | Ahrefs | 0% | 18% | 28 | accepted challenger |
| webinar-virtual-events | Goldcast | 35% | 6% | 17 | endorsed leader |
| webinar-virtual-events | Zoom Webinars | 13% | 21% | 28 | accepted challenger |
| webinar-virtual-events | Livestorm | 10% | 9% | 22 | accepted challenger |
| webinar-virtual-events | ON24 | 10% | 27% | 26 | criticized challenger |
| webinar-virtual-events | Demio | 3% | 7% | 14 | accepted challenger |
| webinar-virtual-events | Microsoft Teams | 3% | 17% | 12 | accepted challenger |
| webinar-virtual-events | Webex Webinars | 0% | 17% | 12 | accepted challenger |
| webinar-virtual-events | Cvent | 0% | 17% | 12 | accepted challenger |
| webinar-virtual-events | Bizzabo | 0% | 36% | 11 | criticized challenger |
| webinar-virtual-events | RingCentral Events | 0% | 40% | 15 | criticized challenger |
| webinar-virtual-events | GoTo Webinar | 0% | 42% | 12 | criticized challenger |

## Treatment of lab-affiliated products by model

Self-preference is only measurable with a control group: how the lab's own model treats its products compared with how every other model treats the same products. Anthropic, OpenAI have no products in the covered categories with enough labels to measure, so nothing is claimed about them.

**Google products** (14 products, 98 labels). Cells are positive/negative/all labels.

| Product | Claude Opus 5 | Claude Opus 4.8 | GPT-6 Astra | GPT-5.6 Sol | Gemini 3.1 Pro | Perplexity Sonar Pro |
|---|---|---|---|---|---|---|
| BigQuery | 5/1/6 | 5/1/6 | 5/1/6 | 5/1/6 | 6/0/6 | 5/0/5 |
| Google Meridian | 6/0/6 | 2/2/4 | 3/1/4 | 3/1/4 | 3/0/3 |  |
| Google Analytics 4 | 2/1/3 | 2/1/3 | 1/2/3 | 2/1/3 | 0/2/2 | 3/2/5 |
| Google Search Console | 2/0/2 | 1/0/1 | 1/0/1 | 1/0/1 | 1/0/1 | 2/0/2 |
| Google Meet |  | 1/0/1 | 1/0/1 |  | 1/0/1 |  |
| YouTube Live | 1/0/1 |  |  | 0/1/1 |  |  |
| Google LightweightMMM | 0/1/1 |  | 0/1/1 |  |  |  |
| Looker Studio | 1/0/1 | 1/0/1 |  |  |  |  |
| Google Keyword Planner |  | 1/0/1 |  |  |  |  |
| Google Trends | 1/0/1 |  |  |  |  |  |
| Google Workspace |  |  |  | 1/0/1 |  |  |
| Looker | 1/0/1 |  |  |  |  |  |
| Google Sites | 1/0/1 |  |  |  |  |  |
| Google Dialogflow |  |  |  |  | 0/1/1 |  |

Mean label weight on Google products: Gemini 3.1 Pro +1.29 over 14 labels; the other 5 models +1.14 over 84 labels. Weights run from +3 (first choice) to -3 (hard negative). A gap under about half a point on this few labels is not a finding.

## Discontinued products recommended

Positive labels on products the catalog marks discontinued. A model offering a shut-down product is a retrieval failure worth naming.

- Grouparoo (Open source reverse ETL, shut down 2023.) labeled alternative by Claude Opus 5 on the budget prompt in data-warehouse-reverse-etl

## Normalization

Unresolved, 225 labels counted under the raw name, for human review:

Adobe Experience Platform Identity Service in identity-resolution (2), Atera in customer-support-helpdesk (2), GEOly AI in ai-visibility-tracking (2), Heeet in attribution-mmm (2), HubSpot's native attribution in attribution-mmm (2), Informa TechTarget Priority Engine in b2b-intent-data (2), Intercom with Fin in chatbots-and-conversational-ai-for-support (2), Kollab in digital-sales-rooms (2), Microsoft Fabric Warehouse in data-warehouse-reverse-etl (2), Middesk in identity-resolution (2), Okta Customer Identity in identity-resolution (2), TruAudience in attribution-mmm (2), Zeta CDP+ in identity-resolution (2), Zoom Webinars / Webinars Plus / Events in webinar-virtual-events (2), AIOSEO in seo-content-optimization (1), ActionIQ / Uniphore CDP Agent in customer-data-platforms (1), AdBeacon in attribution-mmm (1), Adobe in crm (1), Adobe Business Catalyst in marketing-cms (1), Adobe Muse in marketing-cms (1), Ahrefs Free Webmaster Tools in seo-content-optimization (1), Ahrefs' Brand Radar in ai-visibility-tracking (1), Aimdoc in chatbots-and-conversational-ai-for-support (1), Alloy in identity-resolution (1), Amazon Ads attribution in attribution-mmm (1), Amperity Stitch in identity-resolution (1), Artikle.io in b2b-intent-data (1), AssetPanda in customer-support-helpdesk (1), Astiva AI in ai-visibility-tracking (1), Atlassian Customer Service Management in customer-support-helpdesk (1), Attribution.ai in attribution-mmm (1), Attributy Starter in attribution-mmm (1), Autoblogging.ai in seo-content-optimization (1), BMC Remedy in customer-support-helpdesk (1), Bliro in conversation-intelligence (1), BlueJeans / BlueJeans Events in webinar-virtual-events (1), Brainfish in chatbots-and-conversational-ai-for-support (1), BrandWell/Content at Scale in seo-content-optimization (1), Breeze data enrichment in sales-intelligence-and-contact-data (1), BuyerDeck in digital-sales-rooms (1), Byword in seo-content-optimization (1), CData in data-warehouse-reverse-etl (1), Canvas in customer-support-helpdesk (1), Census as a standalone product in customer-data-platforms (1), Character.AI in chatbots-and-conversational-ai-for-support (1), ChatFeatured in ai-visibility-tracking (1), Cheap ChatGPT wrappers and obscure white-label bots in chatbots-and-conversational-ai-for-support (1), Circana — Liquid Mix in attribution-mmm (1), Concrete CMS in marketing-cms (1), D&B Buyer Intent in b2b-intent-data (1), Dageno in ai-visibility-tracking (1), DialogTech in conversation-intelligence (1), Dialpad Ai Sales in conversation-intelligence (1), Distribute.so in digital-sales-rooms (1), Dripify in sales-engagement (1), Drupal 10 in marketing-cms (1), Einstein Conversation Insights in conversation-intelligence (1), Enalitica in attribution-mmm (1), Enjo AI in chatbots-and-conversational-ai-for-support (1), Epsilon CORE ID in identity-resolution (1), Eventbrite in webinar-virtual-events (1), EverHelp in customer-support-helpdesk (1), Expandi in sales-engagement (1), Experian Resolution in identity-resolution (1), Experian identity/marketing products in identity-resolution (1), FICO Identity Resolution Engine in identity-resolution (1), Fini AI in chatbots-and-conversational-ai-for-support (1), Forvio in attribution-mmm (1), Freddy AI in chatbots-and-conversational-ai-for-support (1), Freshdesk + Freddy AI in chatbots-and-conversational-ai-for-support (1), Freshdesk Omni + Freddy AI Agent in chatbots-and-conversational-ai-for-support (1), FullContact / Verisk in identity-resolution (1), GetUntitled in identity-resolution (1), Ghost CMS in marketing-cms (1), Google in attribution-mmm (1), Google Ads conversion modeling in attribution-mmm (1), Google's LightweightMMM in attribution-mmm (1), GravityWrite in seo-content-optimization (1), Hadoop in data-warehouse-reverse-etl (1), Halo in customer-support-helpdesk (1), Heap / Contentsquare Product Analytics in product-analytics (1), Hopin Events / RingCentral Events in webinar-virtual-events (1), HubSpot / Salesforce AI in conversation-intelligence (1), HubSpot Breeze Customer Agent in chatbots-and-conversational-ai-for-support (1), HubSpot Content Hub / CMS Hub in marketing-cms (1), HubSpot Free CMS in marketing-cms (1), HubSpot Service Hub + Breeze Customer Agent in chatbots-and-conversational-ai-for-support (1), HubSpot Service Hub + Customer Agent in chatbots-and-conversational-ai-for-support (1), HubSpot — Free in crm (1), HubSpot's native association tools in identity-resolution (1), IBM Watson in chatbots-and-conversational-ai-for-support (1), In-House Custom Python/Airflow Scripts in data-warehouse-reverse-etl (1), InMarket, X-Mode/Outlogic in identity-resolution (1), Intercom with Fin AI Agent in chatbots-and-conversational-ai-for-support (1), Jitsi Meet in webinar-virtual-events (1), Joomla 3 and 4 in marketing-cms (1), Journey.io in digital-sales-rooms (1), Keyword Planner in seo-content-optimization (1), Klar in attribution-mmm (1), LLMClicks.ai in ai-visibility-tracking (1), Level AI in conversation-intelligence (1), LexisNexis in identity-resolution (1), Liferay in marketing-cms (1), Lifesight / Vidi in attribution-mmm (1), LiveRamp RampID in identity-resolution (1), Macha in chatbots-and-conversational-ai-for-support (1), ManageEngine ServiceDesk in customer-support-helpdesk (1), Marchex in conversation-intelligence (1), MarketMuse Strategy in seo-content-optimization (1), Merkle / Merkury in identity-resolution (1), Merkury by dentsu/Merkle in identity-resolution (1), Meta in attribution-mmm (1), Meta (Facebook) Robyn in attribution-mmm (1), Meta’s AI chatbot in chatbots-and-conversational-ai-for-support (1), Microsoft Dynamics 365 Sales Accelerator in sales-engagement (1), Microsoft Teams Webinars & Town Hall in webinar-virtual-events (1), Modern Drupal (Drupal 10/11) in marketing-cms (1), Mutiny/Proof-style tools in attribution-mmm (1), Netomi in chatbots-and-conversational-ai-for-support (1), Nielsen MMM in attribution-mmm (1), Nimbata in conversation-intelligence (1), Noux in digital-sales-rooms (1), OpenPanel in product-analytics (1), Oracle ADW in data-warehouse-reverse-etl (1), Oracle Advertising, BlueKai, Oracle DMP, Oracle OnRamp/Cross-Device in identity-resolution (1), PandaDoc Rooms in digital-sales-rooms (1), PipelinePRO in sales-engagement (1), Polar Analytics in attribution-mmm (1), PolyAI in conversation-intelligence (1), PopSQL in data-warehouse-reverse-etl (1), PostHog—especially self-hosted in product-analytics (1), PostgreSQL-based warehouses in data-warehouse-reverse-etl (1), PowerSchool's support portal in customer-support-helpdesk (1), Prescient in attribution-mmm (1), Profound Starter / Growth in ai-visibility-tracking (1), Propeo in sales-intelligence-and-contact-data (1), PyMC Marketing in attribution-mmm (1), Ranko in ai-visibility-tracking (1), Rankshift in ai-visibility-tracking (1), Recapped.io in digital-sales-rooms (1), Refract in conversation-intelligence (1), Rev in conversation-intelligence (1), Reverse Contact in identity-resolution (1), RingCentral Events / formerly Hopin in webinar-virtual-events (1), Rockerbox MTA in attribution-mmm (1), RudderStack Reverse ETL in data-warehouse-reverse-etl (1), Run The World in webinar-virtual-events (1), SALESmanago in marketing-automation (1), SE Ranking's AI visibility tool in ai-visibility-tracking (1), SEOBoost in seo-content-optimization (1), SEOeStore in seo-content-optimization (1), Salesforce Agentforce for Service in chatbots-and-conversational-ai-for-support (1), Salesforce Conversation Insights in conversation-intelligence (1), Salesforce Data 360, formerly Data Cloud in customer-data-platforms (1), Salesforce Einstein / HVS / HVC in conversation-intelligence (1), Salesforce Marketing Cloud / Agentforce Marketing suite in marketing-automation (1), Salesforce-native PRM built on Experience Cloud in partner-relationship-management (1), Sally in conversation-intelligence (1), SearchAtlas in seo-content-optimization (1), Seeda in attribution-mmm (1), Segment (Twilio) Reverse ETL in data-warehouse-reverse-etl (1), Self-hosted PostHog in product-analytics (1), Self-hosted WordPress.org in marketing-cms (1), Semrush AI Mode Tracker in ai-visibility-tracking (1), Semrush AI Search Visibility Checker in ai-visibility-tracking (1), Semrush AI Toolkit / AI Visibility in ai-visibility-tracking (1), Semrush/Ahrefs AI features in ai-visibility-tracking (1), Sequel in webinar-virtual-events (1), ServiceNow ITSM in customer-support-helpdesk (1), Sheets, Airtable, or DuckDB in data-warehouse-reverse-etl (1), ShoDeck in digital-sales-rooms (1), SilverStripe in marketing-cms (1), Snowflake / Databricks native approaches in identity-resolution (1), Talkdesk AI in conversation-intelligence (1), Teams Copilot in conversation-intelligence (1), Teams Town Hall in webinar-virtual-events (1), Thena in chatbots-and-conversational-ai-for-support (1), Tidio + Lyro in chatbots-and-conversational-ai-for-support (1), Tixr in webinar-virtual-events (1), TransUnion's TruAudience in identity-resolution (1), Trigify in b2b-intent-data (1), True Influence in b2b-intent-data (1), TrustRadius Intent in b2b-intent-data (1), Twig in chatbots-and-conversational-ai-for-support (1), Twilio in conversation-intelligence (1), Ultimate in chatbots-and-conversational-ai-for-support (1), Umbraco 8, 10, 14, 15, and 16 in marketing-cms (1), Umbraco LTS in marketing-cms (1), Univid in webinar-virtual-events (1), Vapi in conversation-intelligence (1), Vericast Consumer Graph in identity-resolution (1), VisiLead in b2b-intent-data (1), Waikay in ai-visibility-tracking (1), Webex Webinars/Events in webinar-virtual-events (1), WebinarJam + EverWebinar as a pair in webinar-virtual-events (1), WordPress WP Engine / VIP in marketing-cms (1), WordPress on managed hosting, including WordPress VIP in marketing-cms (1), WordPress with managed hosting in marketing-cms (1), WordPress.com Personal in marketing-cms (1), Zendesk Support Suite in customer-support-helpdesk (1), Zingg Community Edition in identity-resolution (1), Zingg.ai in identity-resolution (1), Zoho CRM — Free in crm (1), Zoom Events/Webinars in webinar-virtual-events (1), Zoom Pro + Webinar add-on in webinar-virtual-events (1), Zoom Webinars and Events in webinar-virtual-events (1), c1v-id in identity-resolution (1), idx in identity-resolution (1), mParticle / Rokt in customer-data-platforms (1), open.cx in chatbots-and-conversational-ai-for-support (1), tawk.to + AI Assist in chatbots-and-conversational-ai-for-support (1)

Excluded by rule, 5 labels not scored:

Meta Ads Manager (2; ad platform self-reported attribution, not a vendor in the category), Google Ads (1; ad platform self-reported attribution, not a vendor in the category), Google Sheets (1; general-purpose tool, not a vendor in the category), TikTok (1; ad platform self-reported attribution, not a vendor in the category)

Category-scoped resolutions, 152 labels. A bare vendor name was read as that vendor's product for the asked category, which assigns specificity the model did not write; each one is listed so the assumption is visible:

Salesforce in crm read as Salesforce Sales Cloud (17), HubSpot in crm read as HubSpot CRM (14), HubSpot in marketing-automation read as HubSpot Marketing Hub (11), Salesloft in conversation-intelligence read as Salesloft Conversations (9), HubSpot in email-marketing read as HubSpot Marketing Hub (8), Oracle in customer-data-platforms read as Oracle Unity (7), Ahrefs in ai-visibility-tracking read as Ahrefs Brand Radar (6), HubSpot in customer-data-platforms read as HubSpot (6), Adobe in customer-data-platforms read as Adobe Real-Time CDP (5), Semrush in ai-visibility-tracking read as Semrush AI Visibility Toolkit (5), Outreach in conversation-intelligence read as Outreach Kaia (4), HubSpot in attribution-mmm read as HubSpot Marketing Hub (3), Salesforce in chatbots-and-conversational-ai-for-support read as Salesforce Agentforce (3), Salesforce (Sales Cloud) in crm read as Salesforce Sales Cloud (3), Zoho in crm read as Zoho CRM (3), Clari in conversation-intelligence read as Clari Copilot (2), Clari in sales-engagement read as Groove (2), HubSpot in chatbots-and-conversational-ai-for-support read as HubSpot Service Hub (2), HubSpot in sales-engagement read as HubSpot Sales Hub (2), Oracle in crm read as Oracle Sales (2), Salesforce in customer-data-platforms read as Salesforce Data Cloud (2), Salesforce in identity-resolution read as Salesforce Data Cloud (2), Salesforce in partner-relationship-management read as Salesforce PRM (2), Zoom in webinar-virtual-events read as Zoom Webinars (2), Adobe in identity-resolution read as Adobe Real-Time CDP (1), Adobe in marketing-automation read as Adobe Marketo Engage (1), Ahrefs (Brand Radar) in ai-visibility-tracking read as Ahrefs Brand Radar (1), Clari (with Wingman/Copilot) in conversation-intelligence read as Clari Copilot (1), Freshworks in customer-support-helpdesk read as Freshdesk (1), Freshworks (Freshchat/Freddy AI) in chatbots-and-conversational-ai-for-support read as Freshworks Freddy AI Agent (1), Gong in sales-engagement read as Gong Engage (1), HubSpot in b2b-intent-data read as HubSpot Breeze Intelligence (1), HubSpot (Enterprise Tier) in crm read as HubSpot CRM (1), HubSpot (Free Tools) in chatbots-and-conversational-ai-for-support read as HubSpot Service Hub (1), HubSpot (Marketing Hub) in email-marketing read as HubSpot Marketing Hub (1), HubSpot (Sales Hub Professional) in crm read as HubSpot CRM (1), HubSpot (Sales Hub) in crm read as HubSpot CRM (1), HubSpot (Smart CRM/Customer Platform) in customer-data-platforms read as HubSpot (1), HubSpot (free/starter tiers) in email-marketing read as HubSpot Marketing Hub (1), HubSpot's native tooling in customer-data-platforms read as HubSpot (1), Microsoft in conversation-intelligence read as Microsoft Dynamics 365 Sales (1), Oracle in data-warehouse-reverse-etl read as Oracle Autonomous Data Warehouse (1), Oracle in identity-resolution read as Oracle Unity (1), Outreach (Kaia) in conversation-intelligence read as Outreach Kaia (1), SAP in crm read as SAP Sales Cloud (1), Salesforce in customer-support-helpdesk read as Salesforce Service Cloud (1), Salesforce (Einstein / Agentforce) in chatbots-and-conversational-ai-for-support read as Salesforce Agentforce (1), Salesforce (Sales Cloud / Service Cloud) in crm read as Salesforce Sales Cloud (1), Semrush (AI Optimization Module) in ai-visibility-tracking read as Semrush AI Visibility Toolkit (1), Semrush (AI Visibility Toolkit) in ai-visibility-tracking read as Semrush AI Visibility Toolkit (1), Twilio in customer-data-platforms read as Segment (1), Twilio in identity-resolution read as Twilio Segment Unify (1), Zoho in webinar-virtual-events read as Zoho Webinar (1), Zoom in conversation-intelligence read as Zoom Revenue Accelerator (1)

Combined answers split into one label per product: 6sense/Demandbase, Adobe Commerce/Magento, Allbound / Channelscaler, Atlassian Service Collection/Jira Service Management, Cassandra/Lifesight, Clearbit/HubSpot Breeze, Dealfront/Leadfeeder, DemandScience / Terminus, Demandbase/6sense, Experian/Tapad, Fin / Intercom, Fivetran/Supermetrics, Freshchat/Freshworks, Freshdesk / Freshworks, Freshdesk/Freshdesk Omni, Freshsales/Freshworks, Groove/Salesforce Sales Engagement, Heap / Contentsquare, HubSpot Sales Hub / Salesforce Sales Engagement, Intercom + Fin, Intercom / Fin, Lytics / Contentstack, Microsoft Fabric / Azure Synapse, Neustar / TransUnion, Pardot / Marketing Cloud Account Engagement (Salesforce), Pardot/Account Engagement, Reltio / Informatica MDM, SE Visible / SE Ranking, Salesforce Marketing Cloud / Account Engagement, Salesforce Marketing Cloud/Pardot, Salesforce/Pardot, Salesloft / Outreach, Splink / Zingg, Tilores / Tapad (Experian), TransUnion/Neustar, Webex Webinars & Webex Events, WebinarJam/EverWebinar, Zift Solutions / ZiftONE, Zoom Events & Zoom Webinars, Zoom Webinars & Zoom Events

## Appendix: loose paraphrase stability

- Claude Opus 5: a direct first choice kept as first choice or alternative in 17 of 20 categories (85%); differing under the strict rule: chatbots-and-conversational-ai-for-support, conversation-intelligence, crm, customer-support-helpdesk, data-warehouse-reverse-etl, digital-sales-rooms, identity-resolution, seo-content-optimization, webinar-virtual-events
- Claude Opus 4.8: a direct first choice kept as first choice or alternative in 18 of 20 categories (90%); differing under the strict rule: attribution-mmm, b2b-intent-data, conversation-intelligence, customer-data-platforms, data-warehouse-reverse-etl, digital-sales-rooms, identity-resolution, marketing-cms, partner-relationship-management, product-analytics, sales-engagement, seo-content-optimization, webinar-virtual-events
- GPT-6 Astra: a direct first choice kept as first choice or alternative in 17 of 20 categories (85%); differing under the strict rule: attribution-mmm, b2b-intent-data, chatbots-and-conversational-ai-for-support, customer-support-helpdesk, data-warehouse-reverse-etl, identity-resolution, product-analytics, sales-intelligence-and-contact-data, seo-content-optimization
- GPT-5.6 Sol: a direct first choice kept as first choice or alternative in 16 of 20 categories (80%); differing under the strict rule: ai-visibility-tracking, attribution-mmm, b2b-intent-data, chatbots-and-conversational-ai-for-support, conversation-intelligence, crm, data-warehouse-reverse-etl, identity-resolution, marketing-cms, partner-relationship-management, seo-content-optimization
- Gemini 3.1 Pro: a direct first choice kept as first choice or alternative in 17 of 20 categories (85%); differing under the strict rule: ai-visibility-tracking, attribution-mmm, b2b-intent-data, customer-support-helpdesk, identity-resolution, marketing-cms, product-analytics, sales-intelligence-and-contact-data, seo-content-optimization
- Perplexity Sonar Pro: a direct first choice kept as first choice or alternative in 15 of 20 categories (75%); differing under the strict rule: ai-visibility-tracking, customer-support-helpdesk, data-warehouse-reverse-etl, digital-sales-rooms, identity-resolution, marketing-cms, partner-relationship-management, sales-engagement, sales-intelligence-and-contact-data, seo-content-optimization, webinar-virtual-events