Crawlers and Bots

The following page details network ranges, IPs, and points-of-presence (PoPs) for well known crawlers and bots. We have also provided a list of the top crawler/bot hosting providers.

The crawler/bot data shown here is available in our Netify Data Feeds solution. The data is accessible via our IP API as well as downloadable datasets.

Get Started

We provide network intelligence to help deliver better digital experiences to end users and businesses. Use our APIs and datasets to get started today.

Subscription Plans

Crawler/Bot Hosting - Top 50

The following is a list of the top crawler/bot hosting providers based on the number of different crawlers/bots. Hetzner is the most prevalent provider.

Host Apps IPs
Hetzner - Logo Hetzner 3 638
DigitalOcean - Logo DigitalOcean 2 192
OVHcloud - Logo OVHcloud 2 780
Google Cloud Platform - Logo Google Cloud Platform 2 364
Scaleway - Logo Scaleway 2 1,040
Microsoft Azure - Logo Microsoft Azure 1 4,138
Vultr - Logo Vultr 1 176
Zenlayer - Logo Zenlayer 1 2
Huawei Cloud - Logo Huawei Cloud 1 1,413
Meta CDN - Logo Meta CDN 1 1,854
Hurricane Electric - Logo Hurricane Electric 1 884
Leaseweb - Logo Leaseweb 1 8

Integration and Custom Solutions

Do you have any questions about integration, APIs or custom development?

Contact Us