sam.gov
robots.txt

Robots Exclusion Standard data for sam.gov

Resource Scan

Scan Details

Site Domain sam.gov
Base Domain sam.gov
Scan Status Ok
Last Scan2024-05-04T09:57:53+00:00
Next Scan 2024-06-03T09:57:53+00:00

Last Scan

Scanned2024-05-04T09:57:53+00:00
URL https://sam.gov/robots.txt
Domain IPs 13.227.254.112, 13.227.254.16, 13.227.254.69, 13.227.254.75, 2600:9000:200a:3e00:11:50b8:f440:93a1, 2600:9000:200a:4200:11:50b8:f440:93a1, 2600:9000:200a:a600:11:50b8:f440:93a1, 2600:9000:200a:b600:11:50b8:f440:93a1, 2600:9000:200a:c600:11:50b8:f440:93a1, 2600:9000:200a:ce00:11:50b8:f440:93a1, 2600:9000:200a:e00:11:50b8:f440:93a1, 2600:9000:200a:ea00:11:50b8:f440:93a1
Response IP 13.227.254.112
Found Yes
Hash 4733d91779288eee4e63afa63c0ad42fd20a7cca5049c4aba6a0ced41a48a07f
SimHash ed28d860e3b3

Groups

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5