xd.gov
robots.txt

Robots Exclusion Standard data for xd.gov

Resource Scan

Scan Details

Site Domain xd.gov
Base Domain xd.gov
Scan Status Ok
Last Scan2024-10-27T03:53:53+00:00
Next Scan 2024-11-26T03:53:53+00:00

Last Scan

Scanned2024-10-27T03:53:53+00:00
URL https://www.xd.gov/robots.txt
Domain IPs 13.226.2.109, 13.226.2.128, 13.226.2.45, 13.226.2.68, 2600:9000:20fe:1000:11:44f9:4840:93a1, 2600:9000:20fe:2400:11:44f9:4840:93a1, 2600:9000:20fe:4a00:11:44f9:4840:93a1, 2600:9000:20fe:a00:11:44f9:4840:93a1, 2600:9000:20fe:ac00:11:44f9:4840:93a1, 2600:9000:20fe:b200:11:44f9:4840:93a1, 2600:9000:20fe:c000:11:44f9:4840:93a1, 2600:9000:20fe:f200:11:44f9:4840:93a1
Response IP 108.156.22.10
Found Yes
Hash 4f0cb0178fb3110ac0be2aa9f47415c554547de149fb36ce3df0ccdd76aeaa7f
SimHash 480448634711

Groups

*

Rule Path
Allow /
Disallow /interview-guide$

Other Records

Field Value
sitemap https://xd.gov/sitemap.xml

Warnings

  • `host` is not a known field.