search.usa.gov
robots.txt

Robots Exclusion Standard data for search.usa.gov

Resource Scan

Scan Details

Site Domain search.usa.gov
Base Domain usa.gov
Scan Status Ok
Last Scan2024-06-06T22:45:11+00:00
Next Scan 2024-07-06T22:45:11+00:00

Last Scan

Scanned2024-06-06T22:45:11+00:00
URL https://search.usa.gov/robots.txt
Domain IPs 18.65.3.123, 18.65.3.3, 18.65.3.50, 18.65.3.6, 2600:9000:2366:200:a:4fc7:79c0:93a1, 2600:9000:2366:3200:a:4fc7:79c0:93a1, 2600:9000:2366:4200:a:4fc7:79c0:93a1, 2600:9000:2366:7800:a:4fc7:79c0:93a1, 2600:9000:2366:8200:a:4fc7:79c0:93a1, 2600:9000:2366:a400:a:4fc7:79c0:93a1, 2600:9000:2366:b400:a:4fc7:79c0:93a1, 2600:9000:2366:e00:a:4fc7:79c0:93a1
Response IP 108.157.60.4
Found Yes
Hash 7e052ca0b7fba8e18a1680a42c5456e571ec7cdcf4f936a9a56cd4ebe181456f
SimHash 4810c022e372

Groups

bingbot

Rule Path
Allow /superfresh

*

Rule Path
Disallow /