Log In Sign Up

pubs.er.usgs.gov
robots.txt

Robots Exclusion Standard data for pubs.er.usgs.gov

Resource Scan

Scan Details

Site Domain pubs.er.usgs.gov
Base Domain usgs.gov
Scan Status Ok
Last Scan2024-08-29T02:21:34+00:00
Next Scan 2024-09-28T02:21:34+00:00

Last Scan

Scanned2024-08-29T02:21:34+00:00
URL https://pubs.er.usgs.gov/robots.txt
Redirect https://pubs.usgs.gov/robots.txt
Redirect Domain pubs.usgs.gov
Redirect Base usgs.gov
Domain IPs 108.156.133.104, 108.156.133.117, 108.156.133.38, 108.156.133.81, 2600:9000:2755:2400:d:b3bb:45c0:93a1, 2600:9000:2755:2c00:d:b3bb:45c0:93a1, 2600:9000:2755:4e00:d:b3bb:45c0:93a1, 2600:9000:2755:800:d:b3bb:45c0:93a1, 2600:9000:2755:bc00:d:b3bb:45c0:93a1, 2600:9000:2755:c000:d:b3bb:45c0:93a1, 2600:9000:2755:e400:d:b3bb:45c0:93a1, 2600:9000:2755:e800:d:b3bb:45c0:93a1
Redirect IPs 13.33.28.39, 13.33.28.4, 13.33.28.5, 13.33.28.64, 2600:9000:229f:1e00:1c:ab8b:bec0:93a1, 2600:9000:229f:7400:1c:ab8b:bec0:93a1, 2600:9000:229f:7c00:1c:ab8b:bec0:93a1, 2600:9000:229f:8400:1c:ab8b:bec0:93a1, 2600:9000:229f:b600:1c:ab8b:bec0:93a1, 2600:9000:229f:ce00:1c:ab8b:bec0:93a1, 2600:9000:229f:e00:1c:ab8b:bec0:93a1, 2600:9000:229f:f800:1c:ab8b:bec0:93a1
Response IP 13.33.28.4
Found Yes
Hash df13bf0ac4c68eb5196014d6f05a881f68161b7faeedfdd79fe8770767f86836
SimHash e950d1444790

Groups

*

Rule Path
Disallow /archive/
Back to top