dvd.net.au
robots.txt
Robots Exclusion Standard data for dvd.net.au
Resource Scan
Scan Details
Site Domain | dvd.net.au |
Base Domain | dvd.net.au |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-10-07T18:24:51+00:00 |
Next Scan | 2025-11-06T18:24:51+00:00 |
Last Successful Scan
Scanned | 2025-09-08T15:24:41+00:00 |
URL | https://dvd.net.au/robots.txt |
Domain IPs | 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001 |
Response IP | 104.21.64.1 |
Found | Yes |
Hash | 995894720c4537c39ce7805a95262f1a0e999c659d056062efb80a25dc8f5d65 |
SimHash | 4100dc000d92 |
Other Records
Field | Value |
---|---|
sitemap | https://dvd.net.au/wp-sitemap.xml |