linkbuilder.io
robots.txt

Robots Exclusion Standard data for linkbuilder.io

Resource Scan

Scan Details

Site Domain linkbuilder.io
Base Domain linkbuilder.io
Scan Status Ok
Last Scan2025-11-05T02:16:11+00:00
Next Scan 2025-11-12T02:16:11+00:00

Last Scan

Scanned2025-11-05T02:16:11+00:00
URL https://linkbuilder.io/robots.txt
Domain IPs 104.21.1.219, 172.67.128.24, 2606:4700:3033::6815:1db, 2606:4700:3036::ac43:8018
Response IP 172.67.128.24
Found Yes
Hash 61f4232f40c3dec34231a6201b274335e06f4292f5a900c954d5989c7f77aaf8
SimHash e1301d423f93

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/
Disallow /feed/

Other Records

Field Value
sitemap https://linkbuilder.io/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://linkbuilder.io/
  • live - don't allow web crawlers to index cpresources/ or vendor/