Log In Sign Up

dogechain.dog
robots.txt

Robots Exclusion Standard data for dogechain.dog

Resource Scan

Scan Details

Site Domain dogechain.dog
Base Domain dogechain.dog
Scan Status Ok
Last Scan2024-10-31T13:36:50+00:00
Next Scan 2024-11-30T13:36:50+00:00

Last Scan

Scanned2024-10-31T13:36:50+00:00
URL https://dogechain.dog/robots.txt
Domain IPs 108.156.133.20, 108.156.133.38, 108.156.133.44, 108.156.133.49, 2600:9000:2755:2e00:4:2fe:6c0:93a1, 2600:9000:2755:6200:4:2fe:6c0:93a1, 2600:9000:2755:6400:4:2fe:6c0:93a1, 2600:9000:2755:6600:4:2fe:6c0:93a1, 2600:9000:2755:7a00:4:2fe:6c0:93a1, 2600:9000:2755:b000:4:2fe:6c0:93a1, 2600:9000:2755:cc00:4:2fe:6c0:93a1, 2600:9000:2755:fa00:4:2fe:6c0:93a1
Response IP 108.156.133.49
Found Yes
Hash 4802a3945a785f022ef1d0e478366ac73283cac36418a019faa965d6fcfc06df
SimHash 929d0d8f7450

Groups

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /
Back to top

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-agent: *
  • Disallow: /
Back to top