citywire.co.za
robots.txt
Robots Exclusion Standard data for citywire.co.za
Resource Scan
Scan Details
Site Domain | citywire.co.za |
Base Domain | citywire.co.za |
Scan Status | Ok |
Last Scan | 2024-09-23T06:38:16+00:00 |
Next Scan | 2024-10-23T06:38:16+00:00 |
Last Scan
Scanned | 2024-09-23T06:38:16+00:00 |
URL | https://citywire.co.za/robots.txt |
Redirect | https://citywire.com:443/za/robots.txt |
Redirect Domain | citywire.com |
Redirect Base | citywire.com |
Domain IPs | 3.248.175.219, 46.137.145.40, 52.48.201.156 |
Redirect IPs | 45.60.242.95, 45.60.248.95 |
Response IP | 45.60.248.95 |
Found | Yes |
Hash | d00b9754057e5a9cbe77dec2391362cc24fa58f8e848d5b945c5d8a5d2418116 |
SimHash | 1c524341e010 |
Groups
*
Rule | Path |
---|---|
Disallow | /search$ |
Disallow | /*/search$ |
Disallow | /search? |
Disallow | /*/search? |
Disallow | /sign-in$ |
Disallow | /*/sign-in$ |
Disallow | /sign-in? |
Disallow | /*/sign-in? |
Disallow | /register$ |
Disallow | /*/register$ |
Disallow | /register? |
Disallow | /*/register? |
Disallow | /redirect$ |
Disallow | /*/redirect$ |
Disallow | /redirect? |
Disallow | /*/redirect? |
Disallow | /GetCommentsCount |
Disallow | /*/GetCommentsCount |
Disallow | /GetCommentsCount? |
Disallow | /*/GetCommentsCount? |