harpercollins.com.au
robots.txt
Robots Exclusion Standard data for harpercollins.com.au
Resource Scan
Scan Details
Site Domain | harpercollins.com.au |
Base Domain | harpercollins.com.au |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-10-04T10:44:31+00:00 |
Next Scan | 2024-10-18T10:44:31+00:00 |
Last Successful Scan
Scanned | 2024-08-27T10:43:40+00:00 |
URL | https://harpercollins.com.au/robots.txt |
Domain IPs | 162.159.135.42 |
Response IP | 162.159.135.42 |
Found | Yes |
Hash | 4e3b1a9f4bb1507ae537869997a3c74710a14fa5faf113bacb1eb622748a9480 |
SimHash | 6804d001c1b7 |
Groups
Other Records
Field | Value |
---|---|
sitemap | https://www.harpercollins.com.au/sitemap_index.xml |