ri.gov
robots.txt

Robots Exclusion Standard data for ri.gov

Resource Scan

Scan Details

Site Domain ri.gov
Base Domain ri.gov
Scan Status Ok
Last Scan2024-05-23T23:22:48+00:00
Next Scan 2024-06-22T23:22:48+00:00

Last Scan

Scanned2024-05-23T23:22:48+00:00
URL https://ri.gov/robots.txt
Redirect https://www.ri.gov/robots.txt
Redirect Domain www.ri.gov
Redirect Base ri.gov
Domain IPs 206.16.212.198, 63.241.205.236
Redirect IPs 18.164.174.48, 18.164.174.5, 18.164.174.65, 18.164.174.81
Response IP 18.165.171.73
Found Yes
Hash 4780c0ca9067802bdd7eabd63c0c86fcf754fa91a8c74d1fd6dfcd50fcba6422
SimHash 1445414043d2

Groups

*

Rule Path
Disallow /opengovernment/browse