complaintsbook.co.za
robots.txt
Robots Exclusion Standard data for complaintsbook.co.za
Resource Scan
Scan Details
Site Domain | complaintsbook.co.za |
Base Domain | complaintsbook.co.za |
Scan Status | Ok |
Last Scan | 2024-10-02T00:34:07+00:00 |
Next Scan | 2024-10-09T00:34:07+00:00 |
Last Scan
Scanned | 2024-10-02T00:34:07+00:00 |
URL | https://complaintsbook.co.za/robots.txt |
Domain IPs | 104.21.38.162, 172.67.136.20 |
Response IP | 172.67.136.20 |
Found | Yes |
Hash | c13c5882a72a6cd8fef61db50e6eede516cb956052f05f68ac14251cd2e51354 |
SimHash | eb71bb086000 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /attachments/* |
Disallow | /bo/ |
Disallow | /complaints/follow/* |
Disallow | /compare/* |
Disallow | /assets/* |
Disallow | /docs/* |
Disallow | /images/ |
Disallow | /user/* |
Disallow | /manual/* |
Disallow | /search |
Disallow | /search/* |
Disallow | /*?q=* |
Disallow | /*?p=* |
Disallow | /*.pdf$ |
Disallow |
Other Records
Field | Value |
---|---|
sitemap | https://complaintsbook.co.za/sitemap.xml |
Comments