hostsdg.com
robots.txt
Robots Exclusion Standard data for hostsdg.com
Resource Scan
Scan Details
Site Domain | hostsdg.com |
Base Domain | hostsdg.com |
Scan Status | Ok |
Last Scan | 2025-04-04T12:31:16+00:00 |
Next Scan | 2025-04-18T12:31:16+00:00 |
Last Scan
Scanned | 2025-04-04T12:31:16+00:00 |
URL | https://www.hostsdg.com/robots.txt |
Domain IPs | 104.21.32.187, 172.67.223.238, 2606:4700:3032::ac43:dfee, 2606:4700:3035::6815:20bb |
Response IP | 172.67.223.238 |
Found | Yes |
Hash | 3b3dcc3967bccdd9b9636c5725f4c1aaf386c542720a08551ed16ce65213fcdf |
SimHash | a84ad2006953 |
Groups
*
Rule | Path |
---|---|
Disallow | /contact-us |
Disallow | /legal-agreements |
Disallow | /legal-agreement |
Disallow | /whois |