ProFix Crawler

What it reads

Only public pages on a business's own website: usually the home page and up to four pages such as Contact, About or Services. It notes the business name, the business phone number and email shown on the site, the business address and the type of work the business does.

Business websites are found with the Brave Search API; the crawler then visits the business's own site.

It does not log in, fill in forms, read pages behind a password or collect anything about website visitors.

How it behaves

• It follows robots.txt. If your robots.txt disallows it, it does not visit.
• It visits at most a handful of pages per site per run, about one request per second, and backs off when a site is slow or returns errors.
• It does not revisit a site it has already read unless it is asked to.

What we do with it

A ProFix team member may call or email your business once to introduce our services or to invite you to join our subcontractor network. We do not sell or share the list. We only send text messages to people who agree to receive them.

How to opt out

Stop the crawler visiting your site: add this to your robots.txt:

User-agent: ProFixCrawler
Disallow: /

Stop us contacting your business: email Profix@profixhandyusa.com with your business name, phone number and website, or call 773-440-2252. We will take you off our call list and add your website to the crawler's do-not-visit list.