dtg.org.uk
robots.txt
Robots Exclusion Standard data for dtg.org.uk
Resource Scan
Scan Details
Site Domain | dtg.org.uk |
Base Domain | dtg.org.uk |
Scan Status | Ok |
Last Scan | 2024-05-24T02:36:28+00:00 |
Next Scan | 2024-06-23T02:36:28+00:00 |
Last Scan
Scanned | 2024-05-24T02:36:28+00:00 |
URL | https://dtg.org.uk/robots.txt |
Domain IPs | 104.21.66.216, 172.67.164.174, 2606:4700:3031::ac43:a4ae, 2606:4700:3037::6815:42d8 |
Response IP | 104.21.66.216 |
Found | Yes |
Hash | 264252b6528929b01bdc9ec7af089c5538f1b38855230419e9344bd2d26b420d |
SimHash | e80c08c0ec93 |
Other Records
Field | Value |
---|---|
sitemap | https://dtg.org.uk/sitemap_index.xml |
Comments