planetrugby.com
robots.txt

Robots Exclusion Standard data for planetrugby.com

Resource Scan

Scan Details

Site Domain planetrugby.com
Base Domain planetrugby.com
Scan Status Ok
Last Scan2024-06-04T03:05:21+00:00
Next Scan 2024-06-11T03:05:21+00:00

Last Scan

Scanned2024-06-04T03:05:21+00:00
URL https://planetrugby.com/robots.txt
Redirect https://www.planetrugby.com/robots.txt
Redirect Domain www.planetrugby.com
Redirect Base planetrugby.com
Domain IPs 3.163.24.16, 3.163.24.29, 3.163.24.39, 3.163.24.75
Redirect IPs 2600:9000:2146:4600:e:fbc5:e4c0:93a1, 2600:9000:2146:6800:e:fbc5:e4c0:93a1, 2600:9000:2146:a600:e:fbc5:e4c0:93a1, 2600:9000:2146:ae00:e:fbc5:e4c0:93a1, 2600:9000:2146:ba00:e:fbc5:e4c0:93a1, 2600:9000:2146:d200:e:fbc5:e4c0:93a1, 2600:9000:2146:dc00:e:fbc5:e4c0:93a1, 2600:9000:2146:e600:e:fbc5:e4c0:93a1, 65.8.161.114, 65.8.161.117, 65.8.161.127, 65.8.161.73
Response IP 18.165.171.63
Found Yes
Hash c2fd75ba1f9dce5ce986da89f623a7f949bd3aefb44e4509732e66755a4b7fce
SimHash 420c88a0eb22

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

google-extended

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /