coderbox.dev
robots.txt

Robots Exclusion Standard data for coderbox.dev

Resource Scan

Scan Details

Site Domain coderbox.dev
Base Domain coderbox.dev
Scan Status Ok
Last Scan2024-11-15T00:07:13+00:00
Next Scan 2024-11-22T00:07:13+00:00

Last Scan

Scanned2024-11-15T00:07:13+00:00
URL https://coderbox.dev/robots.txt
Domain IPs 76.76.21.21
Response IP 76.76.21.21
Found Yes
Hash c8fa4cb4d5373429a326721d52902019add0207928503f032bf991260c5ac789
SimHash 4852c1024673

Groups

*

Rule Path
Disallow /accounts
Disallow /detroitchicago/tulsa.js?gcb=195-0&cb=7
Disallow /porpoiseant/jellyfish.webp?a=a&cb=0&shcb=34
Disallow /detroitchicago/tampa.js?gcb=195-0&cb=5
Disallow /detroitchicago/edmonton.webp?a=a&cb=0&shcb=34
Disallow /porpoiseant/jellyfish.webp
Disallow /tardisrocinante/vitals.js?gcb=0&cb=3
Disallow /detroitchicago/minneapolis.js?gcb=195-0&cb=4

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://coderbox.dev/sitemap.xml

Comments

  • Block all crawlers for /accounts
  • Allow all crawlers