vpn.com
robots.txt

Robots Exclusion Standard data for vpn.com

Resource Scan

Scan Details

Site Domain vpn.com
Base Domain vpn.com
Scan Status Ok
Last Scan2025-10-20T12:14:04+00:00
Next Scan 2025-11-19T12:14:04+00:00

Last Scan

Scanned2025-10-20T12:14:04+00:00
URL https://vpn.com/robots.txt
Redirect https://www.vpn.com/robots.txt
Redirect Domain www.vpn.com
Redirect Base vpn.com
Domain IPs 172.66.40.233, 172.66.43.23, 2606:4700:3108::ac42:28e9, 2606:4700:3108::ac42:2b17
Redirect IPs 172.66.40.233, 172.66.43.23, 2606:4700:3108::ac42:28e9, 2606:4700:3108::ac42:2b17
Response IP 172.66.40.233
Found Yes
Hash 9a3e4fe935a7696029acc70e5140beba724115350376fded1e5a39be76784428
SimHash 4b20c862cb82

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /games/
Allow /wp-admin/admin-ajax.php

ahrefsbot

Rule Path
Allow /
Disallow /games/
Disallow /wp-admin/

ia_archiver

Rule Path
Disallow /

cachewarmer

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 0

Other Records

Field Value
sitemap https://www.vpn.com/sitemap_index.xml