Advertisement

Switching media monitoring vendors costs time, disrupts reporting baselines, and frustrates teams who have just learned a new platform. The evaluation process is where you prevent a bad decision. This checklist covers what to verify before signing a contract, with specific focus on UK source coverage, alert performance, and the practical issues that only surface after go-live.

Before the First Demo

Define Your Requirements in Writing

Write a one-page requirements document before contacting vendors. Without one, you will evaluate features you do not need and miss gaps that matter.

Cover:

  • Use cases: Which decisions does the platform support? (Executive briefing, crisis detection, competitor intelligence, PR measurement, social listening)
  • Source requirements: List your Tier 1, Tier 2, and Tier 3 outlets by name. For a UK programme, this means specifying BBC, Sky News, FT, Guardian, Times, Telegraph, plus your sector trade titles (PR Week, Insurance Times, The Grocer, Citywire, Health Service Journal, etc.) and relevant regional press.
  • User count: How many people need access, and at what level (viewer, analyst, admin)?
  • Integration needs: Does the platform need to connect to Slack, Microsoft Teams, a CRM, or a BI tool like Power BI or Looker?
  • Budget range: Know your ceiling. UK media monitoring contracts typically range from GBP 8,000-15,000 per year for basic platforms to GBP 30,000-80,000+ for enterprise solutions with social listening, broadcast, and API access.

Shortlist Two to Four Vendors

The UK market is dominated by a handful of established players. Start with:

  • Meltwater: Broad coverage, strong on volume and social add-on. The most common platform among UK mid-market comms teams.
  • Cision: Deep journalist database, integrated distribution. Strong for teams where media relations and pitching are primary.
  • Signal AI: AI-driven analysis, particularly strong on regulatory and risk monitoring. Increasingly used by financial services and corporate comms teams.
  • Brandwatch: Best-in-class social listening. Weaker on traditional media monitoring. Choose this if social is your primary use case.
  • Pulsar: Strong audience intelligence and narrative analysis. Good complement to media monitoring or standalone for social research.
  • Kantar: Strong on broadcast monitoring and audience measurement. Worth evaluating if broadcast coverage is critical.

Do not evaluate more than four. The evaluation process becomes unwieldy and decision-making stalls.

Coverage and Data Access

This is the most important category for any UK-focused programme.

Source Verification

Ask each vendor for their full UK source list as a spreadsheet. Then check:

  • Nationals: Are all major UK nationals indexed in full text? Some platforms only index headlines or summaries for certain paywalled titles (FT, Times, Telegraph). Full-text access matters for sentiment analysis and message pull-through measurement.
  • Broadcast: Does the platform cover BBC News (TV and radio), Sky News, ITV News, Channel 4 News, LBC, and Times Radio? Are transcripts searchable or only clip-based? Searchable transcripts are far more useful.
  • Regional press: Cross-check against your operational footprint. If you have offices in Manchester, Leeds, and Edinburgh, verify coverage of Manchester Evening News, Yorkshire Post, and The Scotsman.
  • Trade press: This is where the most variance exists between vendors. Check that your three to five priority trade titles are indexed. Ask specifically about smaller or newer titles.
  • Wire services: PA Media, Reuters, and Bloomberg should be covered.
  • Regulatory feeds: If you need to monitor FCA, CMA, ICO, Ofcom, or ASA publications, ask explicitly. Not all platforms index regulatory sources.
  • Refresh rate: How quickly do new articles appear in the system? Best-in-class is under 15 minutes for online content. Some platforms have delays of 1-4 hours for certain source categories.

Data Export

  • Can you export raw data via API or scheduled export?
  • What formats are available (CSV, JSON, Excel, PDF)?
  • Are there export limits (number of items per export, frequency restrictions)?
  • Can you retain exported data after the contract ends?

Common Mistake: The Source List That Was Not Checked

A UK property company signed a 12-month contract with a monitoring vendor based on a strong demo. Three months in, the comms team discovered the platform did not index Estates Gazette, Property Week, or Building -- the three trade titles most read by their investors and partners. The vendor offered to "request" these sources be added, but the process took six months. The team spent the remainder of the contract manually scanning trade outlets they had expected the platform to cover. Always verify the source list against your specific requirements before signing.

Alert Quality and Controls

Run a live test before committing. Ask the vendor to set up your actual monitoring queries during a trial period (most vendors offer a one to two week free trial or paid pilot).

Evaluate:

  • False positive rate: How many alerts are irrelevant? Target: below 30% during trial.
  • Alert speed: Time from article publication to alert delivery. Measure this for at least five articles across different source types.
  • Tiered routing: Can you set different alert rules for different recipients (real-time for crisis team, daily digest for CEO, weekly for analysts)?
  • Exclusion quality: How easy is it to add exclusions and negative keywords? Can you use Boolean logic, proximity operators, and entity-level filtering?
  • Deduplication: Does the system collapse wire story duplicates, or does one PA Media story generate 30 separate alerts?

Sentiment and Analytics

  • Is the sentiment model trained on UK English? US-trained models consistently misclassify British sarcasm, understatement, and passive criticism.
  • Can you override automated sentiment tags? (Essential for Tier 1 coverage that drives decisions)
  • Does the platform offer topic clustering or narrative analysis?
  • How transparent is the sentiment methodology? If the vendor cannot explain how scores are calculated, do not trust the scores.

Reporting and Measurement

  • Can you build custom dashboards without vendor help?
  • Does the platform support quality-weighted share of voice, message pull-through, and coverage quality scoring?
  • Can reports be scheduled and auto-delivered?
  • What export formats are available for board reporting (PowerPoint, PDF)?
  • Can data be pushed to external BI tools (Power BI, Looker, Google Data Studio)?

Contract and Commercial Terms

Read the contract carefully. Common traps:

  • Auto-renewal clauses: Most UK monitoring contracts auto-renew 30-60 days before expiry. Note the cancellation deadline.
  • Seat-based pricing: If you are paying per seat, confirm what "seat" means. Some vendors count any user who has logged in; others count concurrent users.
  • Module bundling: Social listening, broadcast monitoring, API access, and journalist databases are often sold as separate modules. Get a clear price breakdown.
  • Price escalation: Does the contract include annual price increases? Negotiate a cap or fixed pricing.
  • Data ownership: Confirm that you can export all your data before contract termination and that the vendor does not retain proprietary rights to your analysis.

Evaluation Process Timeline

| Week | Activity | |---|---| | 1 | Write requirements document, shortlist vendors | | 2-3 | Run demos using your real brand queries and UK source requirements | | 3-4 | Score vendors independently (at least two evaluators from your team) | | 4-5 | Run a paid or free trial on the top one or two vendors with live queries | | 5-6 | Final scoring, negotiation, contract review | | 7-8 | Onboarding and query setup |

Post-Selection: 90-Day Check-In

Set a review at 90 days after go-live. Confirm:

  • Source coverage matches what was promised
  • Alert quality meets the targets from the trial
  • The team is actually using the platform (check login data)
  • Reporting is integrated into the weekly and monthly comms cadence

If the vendor has underdelivered on a critical requirement, escalate immediately. Do not wait for the annual renewal to raise the issue.

Advertisement