FavicoHub Research Crawler

You've reached this page because an automated request to your server came from this IP address.

What this is

FavicoHub is an independent security-research project. It builds a searchable index of website favicons (the small site-icon files browsers show in tabs and bookmarks) across a large, publicly-ranked list of domains. The index is used for research into shared hosting infrastructure, brand-impersonation detection, and phishing-cluster identification — sites that reuse the same icon file are frequently related, either legitimately (a shared CMS or hosting provider) or maliciously (a cloned phishing page).

What the crawler does

RequestsA small number of lightweight HTTP requests per domain — primarily /favicon.ico and the declared icon links on the homepage.
FrequencyEach domain is visited on an adaptive schedule, generally no more than once every few days, and less often for domains whose icon hasn't changed.
Rate limitingRequests are limited per host and globally; the crawler does not send bursts of traffic to any single server.
robots.txtHonored, including Crawl-delay. A disallow rule for this crawler's user agent is respected on the next visit.

What the crawler does not do

How to identify this traffic

Requests from this project identify themselves with the following User-Agent, which links back to this page:

FavicoHub/1.0 (+https://crawler.favicohub.com/)

Opting out

Add a User-agent: FavicoHub disallow rule to your robots.txt and it will be honored on the next visit. If you'd like your domain excluded immediately, or removed from results that have already been indexed, contact us at the address below and we'll handle it promptly.

Contact

Questions, abuse reports, or removal requests: abuse@favicohub.com