Product analytics
Asked as “product analytics platform”, and as “product analytics tool”, on behalf of a mid-market B2B software company. 29 first choices recorded across the direct, paraphrase, budget and scale prompts, six models each.
Standing
Amplitude38% of first choices, but two endorsed leaders sit here: Mixpanel is four points behind on share and eleven points cleaner on negatives.
First-choice share
Recommended versus criticized
Every product with at least 10 labels here, on both axes. Leader at 30% or more of first choices; criticized at 25% or more negative labels. Markers are keyed to the table below.
Negative label rate →
25% negative
30% first choices
Criticized challenger
Criticized default
Accepted challenger
Endorsed leader
01
02
03
04
05
060%First-choice share →60%
Full standing
Warned against
A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
Google Analytics 456%
9 of 16 labels negative · 6 of 6 models · 4 hard negative
“I'd avoid this for actual product analytics (as opposed to marketing attribution). Data sampling and cardinality thresholding make funnel and retention numbers unreliable” Claude Opus 5, negative prompt
Heap27%
6 of 22 labels negative · 5 of 6 models · 1 hard negative
“You should avoid seeking out or signing new contracts ... **Heap Analytics:** ... It no longer exists as a standalone company” Gemini 3.1 Pro, negative prompt
Amplitude23%
8 of 35 labels negative · 5 of 6 models
“Amplitude only if depth of behavioral analysis is genuinely the bottleneck — otherwise its usage-based pricing tends to outgrow a limited budget fastest” Claude Opus 5, budget prompt
PostHog12%
4 of 34 labels negative · 4 of 6 models · 1 hard negative
“I would avoid treating that deployment as a supported enterprise offering” GPT-6 Astra, negative prompt
Held under rewording
Whether each model's first choice on the direct prompt survived the paraphrase in this category, under the strict rule.
Claude Opus 5
Held
Claude Opus 4.8
Changed
GPT-6 Astra
Changed
GPT-5.6 Sol
Held
Gemini 3.1 Pro
Changed
Perplexity Sonar Pro
Changed
Noise floor in this category
Flips between the edition run and its calibration repeat (simulated until 12 September 2026). Six prompts per model is a small sample; the index-wide floor is the number to trust.
Claude Opus 5
2 of 4 flipped
Claude Opus 4.8
2 of 4 flipped
GPT-6 Astra
1 of 5 flipped
GPT-5.6 Sol
0 of 5 flipped
Gemini 3.1 Pro
3 of 6 flipped
Perplexity Sonar Pro
2 of 4 flipped
What each model said, prompt by prompt
Six framings of the same buying question, each sent to every model in a fresh session with search on. Bold is the first choice, grey the alternatives, red what the answer argued against. Computed from the raw judge labels.
| Prompt | Claude Opus 5 | Claude Opus 4.8 | GPT-6 Astra | GPT-5.6 Sol | Gemini 3.1 Pro | Perplexity Sonar Pro |
|---|---|---|---|---|---|---|
Direct recommendation What is the best product analytics platform for a mid-market B2B software company? | Mixpanel Amplitude, Pendo, PostHog | Amplitude, Mixpanel Heap, Pendo, PostHog | Amplitude Mixpanel, Pendo, PostHog | Amplitude Mixpanel, Pendo, PostHog | Amplitude, Mixpanel Heap, Pendo, PostHog | Amplitude Mixpanel, Pendo |
Paraphrase Which product analytics tool would you recommend to a mid-sized B2B software company? | Mixpanel Gainsight PX, Heap, Pendo, PostHog against: Amplitude | Amplitude Mixpanel, PostHog | Mixpanel Amplitude, Pendo, PostHog | Amplitude Mixpanel, Pendo, PostHog | Mixpanel Amplitude, Pendo, PostHog | Pendo Amplitude, Mixpanel, PostHog |
Comparative What are the top product analytics platforms and how do they differ? | no first choice Amplitude, Heap, Mixpanel, PostHog | Amplitude, Mixpanel Heap, PostHog against: Google Analytics 4 | Amplitude, Mixpanel Fullstory, Heap, Pendo, PostHog | Amplitude Fullstory, Heap, Mixpanel, Pendo +1 against: Google Analytics 4, Snowplow | Amplitude, Mixpanel Heap, Pendo, PostHog | Amplitude Fullstory, Heap, Mixpanel, Pendo +1 against: Google Analytics 4 |
Budget constrained What is the best product analytics platform for a company with a limited budget? | PostHog Mixpanel against: Amplitude | PostHog Amplitude, Google Analytics 4, Mixpanel | PostHog Amplitude | PostHog Amplitude, Google Analytics 4, Mixpanel | PostHog Amplitude, Mixpanel | Mixpanel, PostHog Google Analytics 4 against: Amplitude |
Scale constrained We are a 500 person company evaluating a product analytics platform. What should we look at? | Amplitude, Mixpanel, PostHog Kubit, Mitzu, Pendo | no first choice | Amplitude, Mixpanel Heap, Pendo, PostHog | Amplitude, Mixpanel Contentsquare, Pendo, PostHog | Amplitude Mixpanel, PostHog against: Heap | no first choice |
Negative framing Which product analytics platforms should I avoid or be cautious about? | no first choice Snowplow against: Amplitude, Google Analytics 4, Heap +8 | no first choice Amplitude, Heap, Matomo, Mixpanel +1 against: Google Analytics 4 | no first choice against: Amplitude, Google Analytics 4, Heap +3 | no first choice against: Adobe Analytics, Amplitude, Fullstory +6 | PostHog Matomo, Piwik PRO, Plausible against: Adobe Analytics, Amplitude, Contentsquare +5 | no first choice against: Amplitude, Fullstory, Google Analytics 4 +6 |
Normalization in this category
Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.
Category-scoped readings
None. Every name in this category resolved on its own.
Unresolved, counted raw
None awaiting human review.
Discontinued, still offered
No shut-down product was recommended here.
Every prompt and answer
One row per call: the version string exactly as returned, whether the model searched, sources cited, latency and cost. Full answer text is in the responses download on the Data page.
| Prompt | Model | Version string | Time (UTC) | Searched | Sources | Latency | Cost |
|---|---|---|---|---|---|---|---|
| Direct recommendation | Claude Opus 5 | claude-opus-5 | 2026-09-08 10:15 | yes | 38 | 62 s | $0.29 |
| Direct recommendation | Claude Opus 4.8 | claude-opus-4-8 | 2026-09-08 10:16 | yes | 33 | 50 s | $0.24 |
| Direct recommendation | GPT-6 Astra | gpt-6-astra | 2026-09-08 10:18 | yes | 5 | 36 s | $0.33 |
| Direct recommendation | GPT-5.6 Sol | gpt-5.6-sol | 2026-09-08 10:18 | yes | 5 | 33 s | $0.18 |
| Direct recommendation | Gemini 3.1 Pro | gemini-3.1-pro-preview | 2026-09-08 10:17 | yes | 6 | 45 s | $0.06 |
| Direct recommendation | Perplexity Sonar Pro | sonar-pro | 2026-09-08 10:16 | yes | 20 | 6 s | $0.01 |
| Paraphrase | Claude Opus 5 | claude-opus-5 | 2026-09-08 10:19 | yes | 39 | 72 s | $0.31 |
| Paraphrase | Claude Opus 4.8 | claude-opus-4-8 | 2026-09-08 10:20 | no | 0 | 16 s | $0.05 |
| Paraphrase | GPT-6 Astra | gpt-6-astra | 2026-09-08 10:21 | yes | 6 | 31 s | $0.33 |
| Paraphrase | GPT-5.6 Sol | gpt-5.6-sol | 2026-09-08 10:21 | yes | 5 | 36 s | $0.22 |
| Paraphrase | Gemini 3.1 Pro | gemini-3.1-pro-preview | 2026-09-08 10:20 | no | 0 | 28 s | $0.02 |
| Paraphrase | Perplexity Sonar Pro | sonar-pro | 2026-09-08 10:20 | yes | 17 | 5 s | $0.01 |
| Comparative | Claude Opus 5 | claude-opus-5 | 2026-09-08 10:22 | yes | 28 | 60 s | $0.35 |
| Comparative | Claude Opus 4.8 | claude-opus-4-8 | 2026-09-08 10:23 | yes | 38 | 50 s | $0.25 |
| Comparative | GPT-6 Astra | gpt-6-astra | 2026-09-08 10:25 | yes | 9 | 54 s | $0.57 |
| Comparative | GPT-5.6 Sol | gpt-5.6-sol | 2026-09-08 10:26 | yes | 8 | 68 s | $0.30 |
| Comparative | Gemini 3.1 Pro | gemini-3.1-pro-preview | 2026-09-08 10:24 | yes | 2 | 40 s | $0.05 |
| Comparative | Perplexity Sonar Pro | sonar-pro | 2026-09-08 10:23 | yes | 20 | 10 s | $0.02 |
| Budget constrained | Claude Opus 5 | claude-opus-5 | 2026-09-08 10:27 | yes | 42 | 58 s | $0.40 |
| Budget constrained | Claude Opus 4.8 | claude-opus-4-8 | 2026-09-08 10:28 | yes | 35 | 51 s | $0.24 |
| Budget constrained | GPT-6 Astra | gpt-6-astra | 2026-09-08 10:29 | yes | 3 | 33 s | $0.33 |
| Budget constrained | GPT-5.6 Sol | gpt-5.6-sol | 2026-09-08 10:30 | yes | 5 | 26 s | $0.19 |
| Budget constrained | Gemini 3.1 Pro | gemini-3.1-pro-preview | 2026-09-08 10:29 | yes | 16 | 35 s | $0.05 |
| Budget constrained | Perplexity Sonar Pro | sonar-pro | 2026-09-08 10:28 | yes | 20 | 5 s | $0.01 |
| Scale constrained | Claude Opus 5 | claude-opus-5 | 2026-09-08 10:31 | yes | 31 | 62 s | $0.27 |
| Scale constrained | Claude Opus 4.8 | claude-opus-4-8 | 2026-09-08 10:31 | no | 0 | 29 s | $0.07 |
| Scale constrained | GPT-6 Astra | gpt-6-astra | 2026-09-08 10:33 | yes | 5 | 38 s | $0.35 |
| Scale constrained | GPT-5.6 Sol | gpt-5.6-sol | 2026-09-08 10:34 | yes | 6 | 61 s | $0.20 |
| Scale constrained | Gemini 3.1 Pro | gemini-3.1-pro-preview | 2026-09-08 10:32 | no | 0 | 31 s | $0.03 |
| Scale constrained | Perplexity Sonar Pro | sonar-pro | 2026-09-08 10:31 | yes | 20 | 7 s | $0.01 |
| Negative framing | Claude Opus 5 | claude-opus-5 | 2026-09-08 10:35 | yes | 37 | 84 s | $0.43 |
| Negative framing | Claude Opus 4.8 | claude-opus-4-8 | 2026-09-08 10:36 | yes | 33 | 50 s | $0.20 |
| Negative framing | GPT-6 Astra | gpt-6-astra | 2026-09-08 10:37 | yes | 6 | 37 s | $0.29 |
| Negative framing | GPT-5.6 Sol | gpt-5.6-sol | 2026-09-08 10:39 | yes | 8 | 73 s | $0.32 |
| Negative framing | Gemini 3.1 Pro | gemini-3.1-pro-preview | 2026-09-08 10:37 | yes | 13 | 41 s | $0.05 |
| Negative framing | Perplexity Sonar Pro | sonar-pro | 2026-09-08 10:36 | yes | 20 | 8 s | $0.02 |