permabase.com
robots.txt

Robots Exclusion Standard data for permabase.com

Resource Scan

Scan Details

Site Domain permabase.com
Base Domain permabase.com
Scan Status Ok
Last Scan2025-09-16T05:33:37+00:00
Next Scan 2025-09-23T05:33:37+00:00

Last Scan

Scanned2025-09-16T05:33:37+00:00
URL https://permabase.com/robots.txt
Redirect https://www.permabase.com/robots.txt
Redirect Domain www.permabase.com
Redirect Base permabase.com
Domain IPs 107.20.138.248, 34.233.130.100
Redirect IPs 107.20.138.248, 34.233.130.100
Response IP 34.233.130.100
Found Yes
Hash ab5b3528f8917df70f3dc560c18a8fc7b3c2fa35cf894b4da8e9355329c73de0
SimHash 01601d527d12

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://www.permabase.com/sitemap.xml

Comments

  • robots.txt for https://www.permabase.com/
  • live - don't allow web crawlers to index cpresources/ or vendor/