datacenterhawk.com
robots.txt
Robots Exclusion Standard data for datacenterhawk.com
Resource Scan
Scan Details
Site Domain | datacenterhawk.com |
Base Domain | datacenterhawk.com |
Scan Status | Ok |
Last Scan | 2024-09-24T14:40:05+00:00 |
Next Scan | 2024-10-24T14:40:05+00:00 |
Last Scan
Scanned | 2024-09-24T14:40:05+00:00 |
URL | https://datacenterhawk.com/robots.txt |
Domain IPs | 3.139.243.9, 3.20.71.133 |
Response IP | 3.20.71.133 |
Found | Yes |
Hash | 7911861aec5b093aacededdad028c98add5526d863ec579acc99b590d1dd2933 |
SimHash | cc67cc209c91 |
Groups
*
Rule | Path |
---|---|
Disallow | /data |
Disallow | /admin |
Disallow | /api |
Other Records
Field | Value |
---|---|
sitemap | https://datacenterhawk.com/sitemap_index.xml |
Comments