verbb.io
robots.txt

Robots Exclusion Standard data for verbb.io

Resource Scan

Scan Details

Site Domain verbb.io
Base Domain verbb.io
Scan Status Ok
Last Scan2025-09-23T15:33:11+00:00
Next Scan 2025-09-30T15:33:11+00:00

Last Scan

Scanned2025-09-23T15:33:11+00:00
URL https://verbb.io/robots.txt
Domain IPs 104.21.36.78, 172.67.190.100, 2606:4700:3030::ac43:be64, 2606:4700:3032::6815:244e
Response IP 172.67.190.100
Found Yes
Hash 98dfa8eebe9be9e1c40d81a8629f6a281f8717d76b509eabee46e812334aa83b
SimHash 61701d527f93

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env

Other Records

Field Value
sitemap https://verbb.io/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://verbb.io/
  • live - don't allow web crawlers to index cpresources/ or vendor/