Marketing automation and campaign management
Asked as “marketing automation platform”, and as “marketing automation and campaign management tool”, on behalf of a mid-market B2B company. 52 first choices recorded across the direct, paraphrase, budget and scale prompts, fourteen models each.
Standing · first-choice share
63%
Clear leader
63HubSpot Marketing Hub21Brevo06ActiveCampaign10others
63% of first choices, clear leader.
Since September 2026▲+4Since September 2026: 57% → 61%, +4 points. Inside the 11-point floor: within noise. Read over the models both editions asked.HubSpot Marketing Hub held the lead, +4 points on 57%, inside the 11-point floor.
By buyer segment
The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.
Small business
ActiveCampaign39%Contested▼−11Since September 2026: 51% → 40%, −11 points. Past the 11-point floor: movement. Read over the models both editions asked.Standing →Mid-market
HubSpot Marketing Hub63%Clear leader▲+4Since September 2026: 57% → 61%, +4 points. Inside the 11-point floor: within noise. Read over the models both editions asked.This pageEnterprise
Adobe Marketo Engage53%Clear leader▼−7Since September 2026: 57% → 50%, −7 points. Inside the 11-point floor: within noise. Read over the models both editions asked.Standing →
ActiveCampaign39%Contested▼−11Since September 2026: 51% → 40%, −11 points. Past the 11-point floor: movement. Read over the models both editions asked.Standing →Mid-marketHubSpot Marketing Hub63%Clear leader▲+4Since September 2026: 57% → 61%, +4 points. Inside the 11-point floor: within noise. Read over the models both editions asked.This pageEnterpriseAdobe Marketo Engage53%Clear leader▼−7Since September 2026: 57% → 50%, −7 points. Inside the 11-point floor: within noise. Read over the models both editions asked.Standing →The standing
Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all fourteen models, for a mid-market B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrantSince September 2026
01HubSpot Marketing Hub63%15%73endorsed leader▲+4Since September 2026: 57% → 61%, +4 points. Inside the 11-point floor: within noise. Read over the models both editions asked.57% → 61%
HubSpot Marketing Hub63%15%73endorsed leader▲+4Since September 2026: 57% → 61%, +4 points. Inside the 11-point floor: within noise. Read over the models both editions asked.57% → 61%02
Brevo21%8%24accepted challenger▼−3Since September 2026: 26% → 23%, −3 points. Inside the 11-point floor: within noise. Read over the models both editions asked.26% → 23%
Brevo21%8%24accepted challenger▼−3Since September 2026: 26% → 23%, −3 points. Inside the 11-point floor: within noise. Read over the models both editions asked.26% → 23%03ActiveCampaign6%7%58accepted challenger▼−6Since September 2026: 13% → 7%, −6 points. Inside the 11-point floor: within noise. Read over the models both editions asked.13% → 7%
ActiveCampaign6%7%58accepted challenger▼−6Since September 2026: 13% → 7%, −6 points. Inside the 11-point floor: within noise. Read over the models both editions asked.13% → 7%04
Mailchimp2%43%30criticized challenger▲+2Since September 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 2%
Mailchimp2%43%30criticized challenger▲+2Since September 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 2%Show the seven products at 0%, ordered by negative rate
11
Oracle Eloqua0%44%18criticized challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%
Oracle Eloqua0%44%18criticized challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%09Adobe Marketo Engage0%39%57criticized challenger▼−4Since September 2026: 4% → 0%, −4 points. Inside the 11-point floor: within noise. Read over the models both editions asked.4% → 0%
Adobe Marketo Engage0%39%57criticized challenger▼−4Since September 2026: 4% → 0%, −4 points. Inside the 11-point floor: within noise. Read over the models both editions asked.4% → 0%10
Salesforce Marketing Cloud0%27%15criticized challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%
Salesforce Marketing Cloud0%27%15criticized challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%06
Salesforce Marketing Cloud Account Engagement0%21%39accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%
Salesforce Marketing Cloud Account Engagement0%21%39accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%05
Klaviyo0%12%33accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%
Klaviyo0%12%33accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%07
Omnisend0%8%13accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%
Omnisend0%8%13accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%08
Braze0%0%12accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%
Braze0%0%12accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%The floor is 11 points of share, measured: how far the models move a leader on their own when the same questions are asked twice with nothing changed. A larger change is movement; a smaller one is noise, and both are shown. Movement is read over the twelve models both editions asked; GPT-6 Luna, Muse Glimmer 30B joined this edition and are in the standing but not yet in the comparison. How the floor is measured
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its product page.
Head to head
All six head-to-head pages: the top four products, each against each
One product takes 63% of first choices here, so the chart would put ten markers in one corner and one at the far edge. The two measurements it plots are columns in the standing above: share, and the negative label rate. Four products carry a negative rate above 25% in this category.
What they warned about
Ten of fourteen models held their first choice under the paraphrase. Claude Haiku 4.5, Llama 4 Maverick, Kimi K2 and MiniMax M2.5 changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
Adobe Marketo Engage39%
22 of 57 labels negative · 11 of 14 models · 7 hard negative
“The three platforms I'd most strongly **caution against** ... 1. **Marketo** — unless you're a large enterprise with dedicated admin staff.” DeepSeek V4 Flash, negative prompt
HubSpot Marketing Hub15%
11 of 73 labels negative · 10 of 14 models · 1 hard negative
“Most businesses shouldn't use HubSpot... For everyone else, it's a trap.” Claude Haiku 4.5, negative prompt
Mailchimp43%
13 of 30 labels negative · 8 of 14 models · 2 hard negative
“skip cheap ones (Mailchimp) if you need robust compliance/deliverability” Grok 4.1 Fast, negative prompt
Oracle Eloqua44%
8 of 18 labels negative · 6 of 14 models · 2 hard negative
“It has a high total cost of ownership... Eloqua is generally only suitable for massive Fortune 500 companies” Gemini 3.5 Flash, negative prompt
What they cite
Citations exist only for the models that return a source list: fourteen of the fourteen in this edition, and all six flagship models on the expanded tier.
Sites the answers cite
73 of 84 answers in this category came back with a source list, from 14 of 14 models: citations where the model returns them, or the search results it consulted. 892 links across 277 sites, every framing counted. Ranked by the number of answers carrying the site or page. 2 of the 252 answers across every segment cited this index's own page for the category; the method page measures whether that reading tilts an answer.
vendor site · ZoomInfo22 answers · 38 citations · 10 models
22 answers · 25 citations · 10 models
22 answers · 22 citations · 10 models
vendor site · HubSpot20 answers · 22 citations · 9 models
vendor site · Improvado17 answers · 19 citations · 8 models
vendor site · Klaviyo16 answers · 16 citations · 8 models
vendor site · HubSpot15 answers · 21 citations · 8 models
vendor site · Brevo15 answers · 19 citations · 9 models
vendor site · MarketBetter14 answers · 16 citations · 9 models
vendor site · Zapier14 answers · 15 citations · 8 models
vendor site · GetResponse13 answers · 13 citations · 9 models
vendor site · Make13 answers · 13 citations · 7 models
Pages the answers cite
The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.
22 answers · 10 models
21 answers · 9 models
16 answers · 8 models
15 answers · 8 models
14 answers · 9 models
14 answers · 8 models
13 answers · 6 models
13 answers · 7 models
13 answers · 7 models
13 answers · 7 models
Search against answers
Each company's standing in the answers beside its site's footprint in Google search, one row a site: the products the models named on it with their shares, and the share they add up to; monthly searches on Google, and DataForSEO's estimate of AI search demand (modeled from search signals, directional, not a count of queries to any assistant), for the most-searched of the company's and its products' names (the name is in each row's hover text); estimated monthly organic visits to the site; and its best position in Google's top ten for “best marketing automation platform”, “marketing automation platform”. US estimates from DataForSEO and Google's Ads Transparency Center. A small company's site, or a mid-sized company's site for its flagship, is marked company; a product on a large parent's site (Google, Microsoft) has no site figures. A column with no figures for this category is left out, and an empty cell means none were seen, not none exist. Two measurements side by side: neither is read as the cause of the other.
| Company and products | Share | Own site cited | Name searches, Google | AI search demand, est. | Organic visits | Paid search a month, est. | Google ads, last 30 days | Best Google position |
|---|---|---|---|---|---|---|---|---|
| HubSpot parent site HubSpot Marketing Hub 63% | 63% | 934 | 368,000 | 9,776 | ||||
| Brevo brevo.com Brevo 21%, Brevo [formerly Sendinblue] 2% | 23% | 386 | 40,500 | 327 | 81,741 | $17,847 | 106 | |
| ActiveCampaign activecampaign.com | 6% | 445 | 18,100 | 307 | 235,709 | $1,424 | 32 | |
| Zoho parent site Zoho Marketing Automation 4%, Zoho Campaigns 0% | 4% | 23 | 5,400 | 58 | ||||
| Sender sender.net | 2% | 105 | 9,900 | 10,349 | 69,078 | 13 | ||
| Intuit mailchimp.com Mailchimp 2% | 2% | 339 | 368,000 | 6,862 | 1,931,402 | $1,214 | 107 | |
| Klaviyo klaviyo.com | 0% | 353 | 90,500 | 1,560 | 200,057 | $572 | 20 | 5 |
| Salesforce parent site Salesforce Marketing Cloud Account Engagement 0%, Salesforce Marketing Cloud 0% | 0% | 296 | 550,000 | 60,632 | ||||
| Omnisend omnisend.com | 0% | 185 | 9,900 | 108 | 51,545 | $113 | 66 | |
| Braze braze.com | 0% | 505 | 27,100 | 6,395 | 55,552 | $13,112 | 59 |
Google's top ten for the two searches hold 14 sites; 2 of them are among the sites the models cited here (klaviyo.com, pipeline.zoominfo.com). The first result for “best marketing automation platform” is pipeline.zoominfo.com.
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.ShowHide
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ShowHideModelDirect“What is the best marketing automation platform for a mid-market B2B company?”Paraphrase“Which marketing automation and campaign management tool would you recommend to a mid-sized B2B company?”Comparative“What are the top marketing automation platforms and how do they differ?”Budget-constrained“What is the best marketing automation platform for a company with a limited budget?”Scale-constrained“We are a 500 person company evaluating a marketing automation platform. What should we look at?”Negative“Which marketing automation platforms should I avoid or be cautious about?”
Claude Haiku 4.5HubSpot Marketing Hubno first choiceChangedagainst: Mailchimpno first choiceBrevo, Zoho Marketing Automationno first choiceagainst: Adobe Marketo Engage, Brevo, HubSpot Marketing Hub, Mailchimp, Salesforce Marketing Cloud Account Engagement, SharpSpring
Two alternatives
ActiveCampaign, Adobe Marketo EngageThree alternatives
ActiveCampaign, HubSpot Marketing Hub, MailchimpGPT-5.4 miniHubSpot Marketing HubHubSpot Marketing HubHeldHubSpot Marketing HubZoho Marketing Automationno first choicenothing named
Two alternatives
Adobe Marketo Engage, Salesforce Marketing Cloud Account EngagementTwo alternatives
Adobe Marketo Engage, Salesforce Marketing Cloud Account EngagementFive alternatives
ActiveCampaign, Adobe Marketo Engage, Klaviyo, Mailchimp, Salesforce Marketing CloudTwo alternatives
HubSpot Marketing Hub, HubSpot Sales HubGemini 3.5 FlashHubSpot Marketing HubHubSpot Marketing HubHeldagainst: Adobe Marketo EngageHubSpot Marketing HubBrevoagainst: HubSpot Marketing Hub, Klaviyono first choiceagainst: Adobe Marketo Engage, Salesforce MCAE/Pardotagainst: Adobe Marketo Engage, HubSpot Marketing Hub, Keap, Oracle Eloqua, Salesforce Marketing Cloud Account Engagement
Three alternatives
ActiveCampaign, Adobe Marketo Engage, Salesforce Marketing Cloud Account EngagementTwo alternatives
ActiveCampaign, Salesforce Marketing Cloud Account EngagementSeven alternatives
ActiveCampaign, Adobe Marketo Engage, Brevo, Klaviyo, Mailchimp, Salesforce Marketing Cloud, Salesforce Marketing Cloud Account EngagementFive alternatives
ActiveCampaign, Kit, MailerLite, Omnisend, SenderOne alternative
HubSpot Marketing HubPerplexity SonarHubSpot Marketing HubHubSpot Marketing HubHeldHubSpot Marketing HubBrevono first choiceagainst: AWeber, Adobe Marketo Engage, Mailchimp's free tier, Omnisend, SEnuke TNG, Zoho CRM
Five alternatives
6sense, ActiveCampaign, Adobe Marketo Engage, Customer.io, DemandbaseFour alternatives
ActiveCampaign, Adobe Campaign, Adobe Marketo Engage, Oracle EloquaSeven alternatives
ActiveCampaign, Adobe Marketo Engage, Braze, Customer.io, Klaviyo, Omnisend, Salesforce Marketing CloudThree alternatives
Constant Contact, Mailchimp, SenderGrok 4.1 FastHubSpot Marketing Hubagainst: ActiveCampaign, Oracle EloquaHubSpot Marketing HubHeldagainst: Adobe Marketo Engage, Salesforce Marketing Cloud Account EngagementHubSpot Marketing Hub, KlaviyoHubSpot Marketing Hubagainst: ActiveCampaign, KlaviyoHubSpot Marketing Hubagainst: Oracle Eloquaagainst: Adobe Marketo Engage, Campaigner, HubSpot Marketing Hub, Mailchimp, Oracle Eloqua, Salesforce Marketing Cloud, Salesforce Marketing Cloud Account Engagement, Zoho CRM
Three alternatives
Adobe Marketo Engage, Microsoft Dynamics 365 Customer Insights, Salesforce Marketing Cloud Account EngagementOne alternative
ActiveCampaignFive alternatives
ActiveCampaign, Adobe Marketo Engage, Brevo, Omnisend, Salesforce Marketing CloudThree alternatives
Brevo, Mailchimp, OmnisendTwo alternatives
Adobe Marketo Engage, Salesforce Marketing CloudMistral SmallHubSpot Marketing Hubagainst: Adobe Marketo Engage, Oracle EloquaHubSpot Marketing HubHeldHubSpot Marketing Hubagainst: Act-On, Adobe Marketo EngageBrevono first choiceagainst: HubSpot Marketing Hub, Mailchimp, Salesforce Marketing Cloud
Three alternatives
Act-On, ActiveCampaign, Salesforce Marketing Cloud Account EngagementTwo alternatives
ActiveCampaign, Oracle EloquaFive alternatives
ActiveCampaign, Brevo, Klaviyo, Oracle Eloqua, Salesforce Marketing Cloud Account EngagementTwo alternatives
ActiveCampaign, MailchimpDeepSeek V4 FlashHubSpot Marketing Hubagainst: Adobe Marketo EngageHubSpot Marketing HubHeldagainst: Adobe Marketo EngageHubSpot Marketing HubBrevoagainst: MailchimpHubSpot Marketing Hubagainst: Adobe Marketo Engageagainst: ActiveCampaign, Adobe Marketo Engage, HubSpot Marketing Hub, Mailchimp, Salesforce Marketing Cloud Account Engagement
Two alternatives
ActiveCampaign, Salesforce Marketing Cloud Account EngagementTwo alternatives
ActiveCampaign, Salesforce Marketing Cloud Account EngagementSix alternatives
ActiveCampaign, Adobe Marketo Engage, Braze, Klaviyo, Oracle Eloqua, Salesforce Marketing Cloud Account EngagementThree alternatives
ActiveCampaign, GetResponse, HubSpot Marketing HubThree alternatives
Braze, Iterable, Salesforce Marketing Cloud Account EngagementLlama 4 Maverickno first choiceHubSpot Marketing HubChangedno first choiceBrevono first choiceagainst: Zoho CRM
Three alternatives
Act-On, Adobe Marketo Engage, HubSpot Marketing HubThree alternatives
GetResponse, Mailchimp, MakeQwen 3.7 FlashHubSpot Marketing HubHubSpot Marketing HubHeldHubSpot Marketing HubBrevoagainst: Mailchimpno first choiceagainst: Adobe Marketo Engage, Mailchimpagainst: AWeber, Adobe Marketing Cloud, ClickFunnels, Constant Contact, GetResponse, HubSpot Marketing Hub, Mailchimp, Oracle Eloqua
Three alternatives
ActiveCampaign, Adobe Marketo Engage, Salesforce Marketing Cloud Account EngagementTwo alternatives
ActiveCampaign, Salesforce Marketing Cloud Account EngagementFive alternatives
ActiveCampaign, Adobe Marketo Engage, Klaviyo, Mailchimp, Salesforce Marketing CloudFour alternatives
HubSpot Marketing Hub, Kit, Omnisend, SenderKimi K2ActiveCampaign, HubSpot Marketing Hubagainst: Adobe Marketo EngageHubSpot Marketing HubChangedagainst: Adobe Marketo EngageHubSpot Marketing HubBrevoHubSpot Marketing Hubagainst: Salesforce Marketing Cloud Account Engagementagainst: Adobe Marketo Engage, Brevo, Constant Contact, HubSpot Marketing Hub, Keap, Mailchimp, Salesforce Marketing Cloud Account Engagement
Two alternatives
ActiveCampaign, Salesforce Marketing Cloud Account EngagementFour alternatives
ActiveCampaign, Adobe Marketo Engage, Mailchimp, Salesforce Marketing CloudThree alternatives
HubSpot Marketing Hub, Omnisend, Zoho CampaignsTwo alternatives
ActiveCampaign, Adobe Marketo EngageGLM 4.7 FlashXHubSpot Marketing Hubagainst: Adobe Marketo EngageHubSpot Marketing HubHeldHubSpot Marketing Hubagainst: MailchimpBrevo, SenderActiveCampaign, HubSpot Marketing Hubagainst: Oracle Eloquaagainst: HubSpot Marketing Hub, Mailchimp, Microsoft Dynamics Marketing, Salesforce Marketing Cloud
One alternative
ActiveCampaignThree alternatives
ActiveCampaign, Adobe Marketo Engage, Salesforce Marketing Cloud Account EngagementTwo alternatives
ActiveCampaign, KlaviyoThree alternatives
Klaviyo, MailerLite, OmnisendThree alternatives
Adobe Marketo Engage, Klaviyo, Salesforce Marketing CloudMiniMax M2.5HubSpot Marketing HubActiveCampaign, HubSpot Marketing HubChangedagainst: Klaviyo, MailchimpHubSpot Marketing HubBrevo, Mailchimpno first choiceagainst: Adobe Marketo Engageagainst: Act!, Adobe Marketo Engage, GoldMine, HubSpot Marketing Hub, Keap, Mautic, Oracle Eloqua, Salesforce Marketing Cloud
Three alternatives
ActiveCampaign, Adobe Marketo Engage, Salesforce Marketing Cloud Account EngagementTwo alternatives
Adobe Marketo Engage, Salesforce Marketing Cloud Account EngagementFive alternatives
ActiveCampaign, Adobe Marketo Engage, Brevo, Oracle Eloqua, Salesforce Marketing Cloud Account EngagementThree alternatives
ActiveCampaign, MailerLite, SenderGPT-6 LunaHubSpot Marketing HubHubSpot Marketing HubHeldHubSpot Marketing HubBrevono first choiceagainst: HubSpot Marketing Hub, Klaviyo, Salesforce Marketing Cloud or Account Engagement
Two alternatives
Adobe Marketo Engage, Salesforce Marketing Cloud Account EngagementTwo alternatives
Adobe Marketo Engage, Salesforce Marketing Cloud Account EngagementEight alternatives
ActiveCampaign, Adobe Marketo Engage, Braze, Customer.io, Iterable, Klaviyo, Oracle Eloqua, Salesforce Marketing Cloud Account EngagementTwo alternatives
HubSpot Marketing Hub, MailerLiteMuse Glimmer 30BHubSpot Marketing Hubagainst: Adobe Marketo EngageHubSpot Marketing HubHeldActiveCampaign, HubSpot Marketing HubBrevo [formerly Sendinblue], HubSpot Marketing HubHubSpot Marketing Hubagainst: ActiveCampaign, Adobe Marketo Engage, Salesforce Marketing Cloud Account Engagement
Two alternatives
ActiveCampaign, Salesforce Marketing Cloud Account EngagementThree alternatives
ActiveCampaign, Adobe Marketo Engage, Salesforce Marketing Cloud Account Engagement, formerly PardotSix alternatives
Adobe Marketo Engage, Braze, Customer.io, Klaviyo, Omnisend, Salesforce Marketing Cloud Account EngagementFive alternatives
ActiveCampaign, GetResponse, MailerLite, Sender, Zoho CampaignsTwo alternatives
ActiveCampaign, KlaviyoBold is the first choiceAlternatives are counted; the count opens them.What the answer argued against
The record
One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency. Full answer text is in the free responses file. Download the record
Eighty-four rows: every prompt, every model, every answer.
| Prompt | Model | Version string | Time (UTC) | Searched | Sources | Latency |
|---|---|---|---|---|---|---|
| Direct recommendation | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 13:25 | yes | 9 | 8 s |
| Direct recommendation | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 08:54 | yes | 4 | 5 s |
| Direct recommendation | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 08:47 | yes | 13 | 24 s |
| Direct recommendation | Perplexity Sonar | sonar | 2026-10-01 12:54 | yes | 17 | 4 s |
| Direct recommendation | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 07:36 | yes | 25 | 7 s |
| Direct recommendation | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 10:14 | yes | 7 | 5 s |
| Direct recommendation | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 10:05 | yes | 19 | 24 s |
| Direct recommendation | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 14:07 | yes | 5 | 2 s |
| Direct recommendation | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 10:46 | no | 0 | 27 s |
| Direct recommendation | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 07:41 | yes | 12 | 21 s |
| Direct recommendation | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 09:00 | yes | 25 | 17 s |
| Direct recommendation | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 13:57 | yes | 10 | 19 s |
| Direct recommendation | GPT-6 Luna | gpt-6-luna | 2026-10-01 09:08 | yes | 3 | 15 s |
| Direct recommendation | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 12:21 | yes | 12 | 26 s |
| Paraphrase | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 07:41 | no | 0 | 4 s |
| Paraphrase | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 10:55 | yes | 4 | 4 s |
| Paraphrase | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 12:47 | yes | 9 | 21 s |
| Paraphrase | Perplexity Sonar | sonar | 2026-10-01 07:40 | yes | 19 | 2 s |
| Paraphrase | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 12:19 | yes | 15 | 4 s |
| Paraphrase | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 14:03 | yes | 5 | 3 s |
| Paraphrase | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 10:12 | yes | 22 | 31 s |
| Paraphrase | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 10:38 | yes | 5 | 1 s |
| Paraphrase | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 07:59 | no | 0 | 26 s |
| Paraphrase | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 09:58 | yes | 10 | 16 s |
| Paraphrase | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 12:30 | yes | 10 | 27 s |
| Paraphrase | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 12:23 | yes | 5 | 14 s |
| Paraphrase | GPT-6 Luna | gpt-6-luna | 2026-10-01 07:38 | yes | 3 | 21 s |
| Paraphrase | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 09:41 | yes | 11 | 25 s |
| Comparative | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 13:15 | yes | 9 | 7 s |
| Comparative | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 10:34 | yes | 5 | 6 s |
| Comparative | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 10:28 | yes | 9 | 19 s |
| Comparative | Perplexity Sonar | sonar | 2026-10-01 08:23 | yes | 20 | 5 s |
| Comparative | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 12:55 | yes | 24 | 8 s |
| Comparative | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 08:07 | yes | 10 | 8 s |
| Comparative | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 12:25 | yes | 19 | 25 s |
| Comparative | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 12:48 | yes | 5 | 1 s |
| Comparative | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 10:37 | no | 0 | 31 s |
| Comparative | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 07:36 | yes | 15 | 29 s |
| Comparative | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 12:04 | yes | 25 | 228 s |
| Comparative | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 07:52 | yes | 14 | 20 s |
| Comparative | GPT-6 Luna | gpt-6-luna | 2026-10-01 12:47 | yes | 9 | 27 s |
| Comparative | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 11:44 | yes | 14 | 33 s |
| Budget constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 12:34 | yes | 9 | 8 s |
| Budget constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 11:20 | yes | 2 | 5 s |
| Budget constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 11:09 | yes | 6 | 18 s |
| Budget constrained | Perplexity Sonar | sonar | 2026-10-01 11:56 | yes | 21 | 3 s |
| Budget constrained | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 10:36 | yes | 12 | 4 s |
| Budget constrained | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 11:27 | yes | 5 | 2 s |
| Budget constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 13:30 | yes | 16 | 28 s |
| Budget constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 13:05 | yes | 5 | 2 s |
| Budget constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 09:33 | yes | 9 | 33 s |
| Budget constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 10:00 | yes | 10 | 16 s |
| Budget constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 12:13 | yes | 9 | 144 s |
| Budget constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 09:03 | yes | 5 | 17 s |
| Budget constrained | GPT-6 Luna | gpt-6-luna | 2026-10-01 10:13 | yes | 3 | 9 s |
| Budget constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 12:59 | yes | 11 | 26 s |
| Scale constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 09:57 | no | 0 | 6 s |
| Scale constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 14:13 | no | 0 | 6 s |
| Scale constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 11:05 | yes | 14 | 26 s |
| Scale constrained | Perplexity Sonar | sonar | 2026-10-01 13:58 | yes | 31 | 7 s |
| Scale constrained | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 14:06 | yes | 14 | 9 s |
| Scale constrained | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 08:44 | no | 0 | 8 s |
| Scale constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 10:29 | yes | 20 | 38 s |
| Scale constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 09:36 | yes | 5 | 2 s |
| Scale constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 08:16 | yes | 5 | 35 s |
| Scale constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 13:09 | yes | 14 | 34 s |
| Scale constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 08:39 | yes | 15 | 44 s |
| Scale constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 13:32 | no | 0 | 11 s |
| Scale constrained | GPT-6 Luna | gpt-6-luna | 2026-10-01 14:07 | yes | 2 | 18 s |
| Scale constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 12:19 | yes | 12 | 36 s |
| Negative framing | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 10:53 | yes | 17 | 10 s |
| Negative framing | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 12:19 | no | 0 | 4 s |
| Negative framing | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 13:15 | yes | 11 | 23 s |
| Negative framing | Perplexity Sonar | sonar | 2026-10-01 08:08 | yes | 19 | 6 s |
| Negative framing | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 09:47 | yes | 23 | 7 s |
| Negative framing | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 12:25 | yes | 5 | 5 s |
| Negative framing | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 09:44 | yes | 23 | 46 s |
| Negative framing | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 10:52 | yes | 5 | 1 s |
| Negative framing | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 11:40 | no | 0 | 29 s |
| Negative framing | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 11:22 | yes | 24 | 32 s |
| Negative framing | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 09:40 | yes | 24 | 115 s |
| Negative framing | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 12:43 | no | 0 | 32 s |
| Negative framing | GPT-6 Luna | gpt-6-luna | 2026-10-01 12:58 | yes | 5 | 18 s |
| Negative framing | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 09:57 | yes | 24 | 34 s |
Noise floor in this category
Flips between the edition run and its calibration repeat. Six prompts per model is a small sample; the index-wide floor is the number to trust.
ShowHide
Claude Haiku 4.5
3 of 4 flipped
GPT-5.4 mini
2 of 4 flipped
Gemini 3.5 Flash
2 of 5 flipped
Perplexity Sonar
2 of 4 flipped
Grok 4.1 Fast
4 of 6 flipped
Mistral Small
0 of 4 flipped
DeepSeek V4 Flash
1 of 6 flipped
Llama 4 Maverick
1 of 2 flipped
Qwen 3.7 Flash
3 of 6 flipped
Kimi K2
3 of 5 flipped
GLM 4.7 FlashX
4 of 6 flipped
MiniMax M2.5
2 of 4 flipped
GPT-6 Luna
1 of 4 flipped
Muse Glimmer 30B
3 of 5 flipped
Normalization in this category
Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.
ShowHide
Category-scoped readings
HubSpot read as HubSpot Marketing Hub
HubSpot (Marketing Hub) read as HubSpot Marketing Hub
Oracle read as Oracle Eloqua
Salesforce (Marketing Cloud Account Engagement, formerly Pardot) read as Salesforce Marketing Cloud Account Engagement
Zoho read as Zoho Marketing Automation
Unresolved, counted raw
Act-On Marketing Automation
Intuit Mailchimp All-in-One Marketing Platform
Mailchimp's free tier
SEnuke TNG
Salesforce MCAE/Pardot
Salesforce Marketing Cloud Account Engagement, formerly Pardot
Salesforce Marketing Cloud or Account Engagement
Discontinued, still offered
No shut-down product was recommended here.