collectorlegion.com
robots.txt

Robots Exclusion Standard data for collectorlegion.com

Resource Scan

Scan Details

Site Domain collectorlegion.com
Base Domain collectorlegion.com
Scan Status Ok
Last Scan2026-01-03T05:23:22+00:00
Next Scan 2026-02-02T05:23:22+00:00

Last Scan

Scanned2026-01-03T05:23:22+00:00
URL https://collectorlegion.com/robots.txt
Redirect https://www.collectorlegion.com/robots.txt
Redirect Domain www.collectorlegion.com
Redirect Base collectorlegion.com
Domain IPs 159.89.254.79
Redirect IPs 167.71.187.5, 64.225.7.33
Response IP 64.225.7.33
Found Yes
Hash 1d44af4eb0b695477357dc421303e794ffc0e5b918c3a056318f40a60a6b2899
SimHash 4814cb0077f0

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

*

Rule Path
Disallow /

Comments

  • Allow Google to crawl everything
  • Block all other crawlers