goprojectshift.com
robots.txt

Robots Exclusion Standard data for goprojectshift.com

Resource Scan

Scan Details

Site Domain goprojectshift.com
Base Domain goprojectshift.com
Scan Status Ok
Last Scan2025-07-27T14:03:48+00:00
Next Scan 2025-08-03T14:03:48+00:00

Last Scan

Scanned2025-07-27T14:03:48+00:00
URL https://goprojectshift.com/robots.txt
Redirect https://www.goprojectshift.com/robots.txt
Redirect Domain www.goprojectshift.com
Redirect Base goprojectshift.com
Domain IPs 50.16.35.210
Redirect IPs 3.88.158.210
Response IP 3.88.158.210
Found Yes
Hash 6326092819971f8cb1dc1b8ec11e088699c1ccc1b180515010555223d2dfd6f1
SimHash 0170197277b2

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://ms-crc-prod.frb.io/sitemaps-2-sitemap.xml

Comments

  • robots.txt for https://ms-crc-prod.frb.io/
  • live - don't allow web crawlers to index cpresources/ or vendor/