ic3.gov
robots.txt

Robots Exclusion Standard data for ic3.gov

Resource Scan

Scan Details

Site Domain ic3.gov
Base Domain ic3.gov
Scan Status Ok
Last Scan2026-02-20T04:14:36+00:00
Next Scan 2026-03-22T04:14:36+00:00

Last Scan

Scanned2026-02-20T04:14:36+00:00
URL https://ic3.gov/robots.txt
Redirect https://www.ic3.gov/robots.txt
Redirect Domain www.ic3.gov
Redirect Base ic3.gov
Domain IPs 20.141.170.64, 2001:489a:3102:6::62, 2001:489a:3600::13, 52.126.48.246
Redirect IPs 20.140.151.75, 2001:489a:3604::7c0
Response IP 20.140.151.75
Found Yes
Hash 9d3cb904ecfa10ecf1e7170e0f880214970f6bd86f807b9f38bcf7c78a43da67
SimHash fc6b6c40a592

Groups

*

Rule Path
Disallow /assets/
Disallow /css/
Disallow /img/
Disallow /ContactFBICyber/
Disallow /PIFSurvey/
Disallow /Search/

Comments

  • robots.txt - IC3.gov