ne.gov
robots.txt

Robots Exclusion Standard data for ne.gov

Resource Scan

Scan Details

Site Domain ne.gov
Base Domain ne.gov
Scan Status Ok
Last Scan2024-06-23T01:35:10+00:00
Next Scan 2024-07-23T01:35:10+00:00

Last Scan

Scanned2024-06-23T01:35:10+00:00
URL http://ne.gov/robots.txt
Redirect https://www.nebraska.gov/robots.txt
Redirect Domain www.nebraska.gov
Redirect Base nebraska.gov
Domain IPs 206.16.212.82
Redirect IPs 206.16.212.82
Response IP 206.16.212.82
Found Yes
Hash 3ac029bda1410a7f79d4803d73bc066efc36d245a0b96852f0249ac16b4b5bb4
SimHash 5055ca00d591

Groups

*

Rule Path
Disallow /demo/billtrack/
Disallow /app-fsp/
Allow /
Allow /sitemap.xml