my-catalogue.nz
robots.txt
Robots Exclusion Standard data for my-catalogue.nz
Resource Scan
Scan Details
Site Domain | my-catalogue.nz |
Base Domain | my-catalogue.nz |
Scan Status | Ok |
Last Scan | 2024-09-17T07:21:49+00:00 |
Next Scan | 2024-09-24T07:21:49+00:00 |
Last Scan
Scanned | 2024-09-17T07:21:49+00:00 |
URL | https://my-catalogue.nz/robots.txt |
Domain IPs | 104.21.52.152, 172.67.200.225, 2606:4700:3030::ac43:c8e1, 2606:4700:3032::6815:3498 |
Response IP | 104.21.52.152 |
Found | Yes |
Hash | 6dd49f45867023b98e7088b7697207efd22239fa278768602b5e6c511d04912b |
SimHash | 20455c30a953 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin |
Disallow | /n/* |
Disallow | *taghash* |
Disallow | *cutterhash* |
Disallow | *open-street-map* |
Disallow | /user* |
Disallow | *?*hash=* |
Other Records
Field | Value |
---|---|
sitemap | https://my-catalogue.nz/sitemap-index.xml |