USE CASE:
Media companies: page discovery without the guesswork
Everything below is about one job: page discovery for media companies, done in a way that survives a list rather than a single lookup. Mamba Labs builds the Apify actors named here, so Page Finder Extractor is something you run yourself against your own list of media companies.
The problem
Media companies distort page discovery, for a reason specific to them. Media companies are measured by audience and paid by advertisers, so their customer is not their reader, which shapes page discovery. What catches people out on media companies, page discovery included: traffic estimates are the qualifier and they are the least reliable number available. There is 1 runnable example of page discovery for media companies below.
Traditional Search Tools
- Their own media kit, for media companies. Free, self reported, and more specific than any third party estimate.
- Google with a site operator. Free and precise. Fine for twenty companies, and rate limited into uselessness past that.
- Screaming Frog. Crawls a whole site and finds every page matching a pattern. Built for one site at a time rather than a list of hundreds.
- Guessing the URL. Try slash pricing. It works surprisingly often and fails silently, which is the problem.
- Search the site. A site search in Google with the term you want gets you there in one query per company. Reliable, and it is still one query per company.
Preconfigured tasks
A task is one of these actors with the inputs already filled in for a specific version of this job. Open one, swap in your own list, and run it without setting anything up from scratch.
Mamba Labs Apify Actors
These are the actors we built for this job. If yours is not covered here, search from the bar at the top of the page or contact us here and tell us what you need.
- Page Finder Extractor1 preconfigured task on this page's job.