sapetmarket.co.za
robots.txt

Robots Exclusion Standard data for sapetmarket.co.za

Resource Scan

Scan Details

Site Domain sapetmarket.co.za
Base Domain sapetmarket.co.za
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-07-28T13:19:02+00:00
Next Scan 2024-10-26T13:19:02+00:00

Last Successful Scan

Scanned2023-10-09T13:15:18+00:00
URL https://sapetmarket.co.za/robots.txt
Redirect https://sapetmarket.wordpress.com/robots.txt
Redirect Domain sapetmarket.wordpress.com
Redirect Base wordpress.com
Domain IPs 192.0.78.161, 192.0.78.196
Redirect IPs 192.0.78.12, 192.0.78.13
Response IP 192.0.78.12
Found Yes
Hash cbf091efe4b2172dfe83b6598a9b8d17df6bf58735f7aa6269567bf896e95365
SimHash b89b96862133

Groups

*

Rule Path
Disallow /

Comments

  • This file was generated on Wed, 04 Oct 2023 10:32:50 +0000