Zero of twelve models named Convert first on the direct prompt; one named Optimizely CMS. Convert was named by ten of the twelve models and Optimizely CMS by twelve and Convert carries 17 labels and Optimizely CMS 47, so the shares are not directly comparable.
Named in one category this edition.
By Optimizely, San Francisco, United States, founded 2010. Named in eight categories this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all twelve models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the experimentation and personalization page.
Across every category in the September 2026 Edition, Convert and Optimizely CMS were named in the same answer forty-one times, of the 53 answers naming Convert and the 195 naming Optimizely CMS. In those answers Optimizely CMS took the first choice seven times and Convert nine.
| Model | Direct | Paraphrase | Comparative | Budget-constrained | Scale-constrained | Negative |
|---|---|---|---|---|---|---|
| Claude Haiku 4.5 | ||||||
| GPT-5.4 mini | ||||||
| Gemini 3.5 Flash | ||||||
| Perplexity Sonar | ||||||
| Grok 4.1 Fast | ||||||
| Mistral Small | ||||||
| DeepSeek V4 Flash | ||||||
| Llama 4 Maverick | ||||||
| Qwen 3.7 Flash | ||||||
| Kimi K2 | ||||||
| GLM 4.7 FlashX | ||||||
| MiniMax M2.5 |
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Three of four in this category shown.
“I would recommend Convert.com if you want a strong balance of reliability, privacy, and straightforward pricing” Perplexity Sonar · paraphrase prompt · first choice
“I would recommend Convert.com as the best A/B testing and personalization tool for a mid-sized B2B company” Llama 4 Maverick · paraphrase prompt · first choice
“Privacy-first (excellent GDPR), affordable (~$299+/month), up to 50 goals/test.” Grok 4.1 Fast · negative prompt · first choice
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of eight in this category shown.
“Major Structural / Commercial Red Flags ... Optimizely ... Extreme pricing opacity ... Security incidents” Kimi K2 · negative prompt · hard negative
“High Cost, Declining Support, Rigid Platform... Be very cautious | Optimizely (for SMB/mid-market)” DeepSeek V4 Flash · negative prompt · hard negative
“Platforms to Avoid or Be Very Cautious About ... 1. Optimizely (Now part of Episerver)” Mistral Small · negative prompt · hard negative
“Deepest experimentation infrastructure - considered the enterprise standard for A/B testing... The most mature experimentation platform” Mistral Small · comparative prompt · first choice
“The category reference point for statistical rigor... Choose Optimizely if: You need the most rigorous experimentation program” Kimi K2 · comparative prompt · first choice
“Optimizely — best-in-class statistical rigor + feature experimentation; needs some engineering support; enterprise pricing” DeepSeek V4 Flash · scale prompt · first choice
Comparisons are drawn for the top eight products in each category, each against each. The output is the models' output; nothing here is a recommendation by the index.