pagely.co.za
robots.txt
Robots Exclusion Standard data for pagely.co.za
Resource Scan
Scan Details
Site Domain | pagely.co.za |
Base Domain | pagely.co.za |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a server error. |
Last Scan | 2024-10-31T06:38:17+00:00 |
Next Scan | 2025-01-29T06:38:17+00:00 |
Last Successful Scan
Scanned | 2024-07-04T06:36:40+00:00 |
URL | https://pagely.co.za/robots.txt |
Domain IPs | 104.21.32.95, 172.67.150.172, 2606:4700:3031::6815:205f, 2606:4700:3033::ac43:96ac |
Response IP | 172.67.150.172 |
Found | Yes |
Hash | eb693e583b1b9a171240cc1b564318164155920d5111f75d6acc54c063bc16cf |
SimHash | 49010c400f92 |
Other Records
Field | Value |
---|---|
sitemap | https://pagely.co.za/sitemap_index.xml |