gpforums.co.nz
robots.txt

Robots Exclusion Standard data for gpforums.co.nz

Resource Scan

Scan Details

Site Domain gpforums.co.nz
Base Domain gpforums.co.nz
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-15T04:48:16+00:00
Next Scan 2024-09-13T04:48:16+00:00

Last Successful Scan

Scanned2024-02-17T04:47:07+00:00
URL https://gpforums.co.nz/robots.txt
Domain IPs 104.21.45.215, 172.67.219.52, 2606:4700:3030::ac43:db34, 2606:4700:3036::6815:2dd7
Response IP 104.21.45.215
Found Yes
Hash d17335926b36af91cffb3690e86c6e9bcffe49a84b58e8dd5474e5b5321b4641
SimHash 6d74d84161d0

Groups

googlebot
google
mediapartners-google
bingbot
bing
gptbot

Rule Path
Disallow /search.php
Disallow /themousepad/

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /