USE CASE:
The annual report page and the page discovery problem
What follows is the honest set of ways to get page discovery on the annual report page, including the ones that are not ours. Mamba Labs builds the Apify actors named here, so Page Finder Extractor is something you run yourself against your own list of the annual report page.
Where this starts
Page discovery for the annual report page stops being a lookup and becomes a project. Any page discovery method has to survive this: the annual report page sits at no fixed URL, because there is no convention and never was one. What catches people out on the annual report page, page discovery included: guessing the path works often enough to look reliable and fails silently when it does not. If you would rather try it than read about it, Page Finder Extractor does page discovery for the annual report page today.
What is at stake
The question about the annual report page is simple and the work is opening several hundred websites and clicking around each one.
Traditional Search Tools
- A site search operator, for the annual report page. Free, precise, and rate limited into uselessness past twenty companies.
- Google with a site operator. Free and precise. Fine for twenty companies, and rate limited into uselessness past that.
- Screaming Frog. Crawls a whole site and finds every page matching a pattern. Built for one site at a time rather than a list of hundreds.
- Guessing the URL. Try slash pricing. It works surprisingly often and fails silently, which is the problem.
- Search the site. A site search in Google with the term you want gets you there in one query per company. Reliable, and it is still one query per company.
Mamba Labs Apify Actors
These are the actors we built for this job. If yours is not covered here, search from the bar at the top of the page or contact us here and tell us what you need.
- Page Finder Extractor1 preconfigured task on this page's job.
Preconfigured tasks
A task is one of these actors with the inputs already filled in for a specific version of this job. Open one, swap in your own list, and run it without setting anything up from scratch.