USE CASE:

Getting page discovery right for law companies

This page is about page discovery for law companies: the options you actually have, what each one costs, and which one we would pick. Mamba Labs builds the Apify actors named here, so Page Finder Extractor is something you run yourself against your own list of law companies.

The problem

Law companies distort page discovery, for a reason specific to them. Start from this: law companies are conservative buyers who move when a regulator or an insurer makes them, and page discovery follows. What catches people out on law companies, page discovery included: firm size is measured in partners and fee earners, not employees, and the two differ by triple. There is 1 runnable example of page discovery for law companies below.

What is at stake

The question about law companies is simple and the work is opening several hundred websites and clicking around each one.

Traditional Search Tools

  • The regulator's firm search, for law companies. Free, and it carries the regulated entity and its permissions.
  • Google with a site operator. Free and precise. Fine for twenty companies, and rate limited into uselessness past that.
  • Screaming Frog. Crawls a whole site and finds every page matching a pattern. Built for one site at a time rather than a list of hundreds.
  • Guessing the URL. Try slash pricing. It works surprisingly often and fails silently, which is the problem.
  • Search the site. A site search in Google with the term you want gets you there in one query per company. Reliable, and it is still one query per company.

Mamba Labs Apify Actors

These are the actors we built for this job. If yours is not covered here, search from the bar at the top of the page or contact us here and tell us what you need.

Preconfigured tasks

A task is one of these actors with the inputs already filled in for a specific version of this job. Open one, swap in your own list, and run it without setting anything up from scratch.