jobs27.co.za
robots.txt

Robots Exclusion Standard data for jobs27.co.za

Resource Scan

Scan Details

Site Domain jobs27.co.za
Base Domain jobs27.co.za
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-04-04T19:29:09+00:00
Next Scan 2024-07-03T19:29:09+00:00

Last Successful Scan

Scanned2023-09-07T07:49:29+00:00
URL https://jobs27.co.za/robots.txt
Redirect https://www.jobs27.co.za/robots.txt
Redirect Domain www.jobs27.co.za
Redirect Base jobs27.co.za
Domain IPs 216.239.32.21, 216.239.34.21, 216.239.36.21, 216.239.38.21
Redirect IPs 2404:6800:4003:c0f::79, 74.125.24.121
Response IP 64.233.170.121
Found Yes
Hash cafa87208b48d63a5789288ec60d5a2ed2aa3d61552fe1782c499c304bf72dd2
SimHash 2b0496604e93

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /search
Allow /

Other Records

Field Value
sitemap https://www.jobs27.co.za/sitemap.xml