colors.codes
robots.txt

Robots Exclusion Standard data for colors.codes

Resource Scan

Scan Details

Site Domain colors.codes
Base Domain colors.codes
Scan Status Ok
Last Scan2025-10-02T00:08:50+00:00
Next Scan 2025-10-16T00:08:50+00:00

Last Scan

Scanned2025-10-02T00:08:50+00:00
URL https://colors.codes/robots.txt
Domain IPs 147.93.109.111, 2a02:4780:11:1189:0:921:4bf0:5
Response IP 147.93.109.111
Found Yes
Hash 9f79fc29329a10abf97571aa88c7f1dfdbd488f99378a711bf53e47eb153e563
SimHash 611c0ac2f6b0

Groups

*

Rule Path
Allow /
Allow /sitemap.xml
Allow /images/
Disallow /temp/
Disallow /dev/
Disallow /admin/
Disallow /private/

adsbot-google

Rule Path
Allow /

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://colors.codes/sitemap.xml

Comments

  • Block sensitive directories
  • Crawl-delay for specific bots