Measurement
Part of Podcast creative experiments
Testing an offer without changing the show mix
Compare two podcast offers across a stable show mix, check both response routes and judge the commercial outcome with clear limits.
To compare two podcast offers, try to run both across the same eligible shows, positions, Australian targeting rules and period. Change the benefit and its necessary terms while keeping the surrounding message as steady as possible. Judge by the business outcome that matters: more code use from a larger discount may still deliver less value.
Define the offer decision
State which two approved offers are being compared and which customers and products qualify. Agree on the primary outcome and response window before launch. Depending on the decision, that might be accepted orders, qualified enquiries or contribution after the incentive and relevant costs. Decide how refunds and cancellations will be treated.
An offer change is the treatment, not merely a copy change. Keep the host, product explanation, sponsor identification and spoken route consistent where the differing terms allow. Make each benefit and its important conditions clear to the intended customer.
Key Steps for Testing a Podcast Offer Without Changing the Show Mix
- Define the two approved offers and qualifying customers/products
- Agree on primary outcome (e.g., accepted orders, qualified enquiries) and response window
- Ensure host, product explanation, and sponsor identification remain consistent
- Record planned and actual delivery by version, show, and date
- Compare commercial value, adjusting for delivery differences and incentive costs
Balance delivery within shows
Ask whether each participating show can carry both versions during the same period. Confirm the placement, duration and how the seller will assign them. If one show accepts only offer A and another only offer B, the result mixes offer and show differences even if campaign delivery totals match.
Record planned and actual delivery by version, show and date, plus substitutions. If the offers can run only in successive periods, note other promotions, demand changes and episode topics. That sequence offers weaker evidence about which offer caused an observed difference.
Keep response routes equivalent
If the offers use separate codes, make them similarly easy to say and enter. Check that each code applies to the intended products and customers and that checkout presents the promised benefit and terms. Remove setup transactions from campaign totals. Use the same landing-page layout and purchase steps where the different terms allow.
Record other places each code appears. A code may be shared beyond podcast listeners; an influenced customer may buy without using one. The order system’s accepted-code count is useful, but it is not a complete measure of the podcast’s sales effect.
Key Metrics to Track in Podcast Offer Testing
- Response Route Consistency
- Codes must be equally easy to say and enter
- Checkout Accuracy
- Promised benefit and terms must match checkout experience
- Setup Transactions Excluded
- Not counted in campaign totals
- Landing Page Consistency
- Same layout and purchase steps where possible
Compare commercial value
Reconcile delivery and route operation first. Compare the preselected outcome over the agreed window, accounting for differences in delivery or spend and the cost of each incentive. Do not choose by raw order totals if one offer received more delivery. If the show mix differs, outcomes are sparse or one checkout route failed, leave the offer question unresolved and fix that problem in the next comparison.
Keep the approved terms, audio versions and calculation basis with the result. An offer that produces more orders may still be the poorer choice under the advertiser’s own contribution rule.
Comparing Two Podcast Offers Across the Same Show Mix
- Offer A
- Higher discount, more delivery, lower contribution after costs
- Offer B
- Smaller discount, less delivery, higher contribution after costs



