planetrugby.com
robots.txt

Robots Exclusion Standard data for planetrugby.com

Resource Scan

Scan Details

Site Domain planetrugby.com
Base Domain planetrugby.com
Scan Status Ok
Last Scan2024-11-13T12:25:31+00:00
Next Scan 2024-11-20T12:25:31+00:00

Last Scan

Scanned2024-11-13T12:25:31+00:00
URL https://planetrugby.com/robots.txt
Redirect https://www.planetrugby.com/robots.txt
Redirect Domain www.planetrugby.com
Redirect Base planetrugby.com
Domain IPs 3.160.188.2, 3.160.188.28, 3.160.188.41, 3.160.188.75
Redirect IPs 2600:9000:269a:1a00:e:fbc5:e4c0:93a1, 2600:9000:269a:3800:e:fbc5:e4c0:93a1, 2600:9000:269a:3e00:e:fbc5:e4c0:93a1, 2600:9000:269a:5400:e:fbc5:e4c0:93a1, 2600:9000:269a:6600:e:fbc5:e4c0:93a1, 2600:9000:269a:d000:e:fbc5:e4c0:93a1, 2600:9000:269a:d200:e:fbc5:e4c0:93a1, 2600:9000:269a:de00:e:fbc5:e4c0:93a1, 3.160.188.2, 3.160.188.28, 3.160.188.41, 3.160.188.75
Response IP 108.156.22.68
Found Yes
Hash c2fd75ba1f9dce5ce986da89f623a7f949bd3aefb44e4509732e66755a4b7fce
SimHash 420c88a0eb22

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

google-extended

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /