Log In Sign Up

brookingsutilities.com
robots.txt

Robots Exclusion Standard data for brookingsutilities.com

Resource Scan

Scan Details

Site Domain brookingsutilities.com
Base Domain brookingsutilities.com
Scan Status Ok
Last Scan2024-09-28T02:11:39+00:00
Next Scan 2024-10-05T02:11:39+00:00

Last Scan

Scanned2024-09-28T02:11:39+00:00
URL https://brookingsutilities.com/robots.txt
Redirect https://www.brookingsutilities.com/robots.txt
Redirect Domain www.brookingsutilities.com
Redirect Base brookingsutilities.com
Domain IPs 54.68.90.72
Redirect IPs 18.155.68.109, 18.155.68.124, 18.155.68.50, 18.155.68.82, 2600:9000:23d2:2800:b:4ad1:d400:93a1, 2600:9000:23d2:2e00:b:4ad1:d400:93a1, 2600:9000:23d2:3c00:b:4ad1:d400:93a1, 2600:9000:23d2:3e00:b:4ad1:d400:93a1, 2600:9000:23d2:4000:b:4ad1:d400:93a1, 2600:9000:23d2:5a00:b:4ad1:d400:93a1, 2600:9000:23d2:6c00:b:4ad1:d400:93a1, 2600:9000:23d2:9a00:b:4ad1:d400:93a1
Response IP 18.155.68.109
Found Yes
Hash c0b230e99e3dced452c98d6c702676d168e38b848ae9a68be0c214c352a96df2
SimHash 414219762fb2

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Back to top

Other Records

Field Value
sitemap https://www.brookingsutilities.com/sitemaps-1-sitemap.xml
Back to top

Comments

  • robots.txt for https://www.brookingsutilities.com/
  • live - don't allow web crawlers to index cpresources/ or vendor/
Back to top