scoop.com.au
robots.txt
Robots Exclusion Standard data for scoop.com.au
Resource Scan
Scan Details
Site Domain | scoop.com.au |
Base Domain | scoop.com.au |
Scan Status | Ok |
Last Scan | 2024-11-13T05:44:16+00:00 |
Next Scan | 2024-11-20T05:44:16+00:00 |
Last Scan
Scanned | 2024-11-13T05:44:16+00:00 |
URL | https://scoop.com.au/robots.txt |
Domain IPs | 162.159.136.54, 162.159.137.54, 2606:4700:7::a29f:8836, 2606:4700:7::a29f:8936 |
Response IP | 162.159.136.54 |
Found | Yes |
Hash | 07ed0c2e7d6d4423d81f0117a5eb81ca94afad4c8c476867a9aa1a41484c8f3f |
SimHash | 6901d840cd92 |
Other Records
Field | Value |
---|---|
sitemap | https://scoop.com.au/sitemaps.xml |