gate.reddoorz.com
robots.txt

Robots Exclusion Standard data for gate.reddoorz.com

Resource Scan

Scan Details

Site Domain gate.reddoorz.com
Base Domain reddoorz.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-19T05:26:20+00:00
Next Scan 2024-11-18T05:26:20+00:00

Last Successful Scan

Scanned2024-08-28T05:25:26+00:00
URL https://gate.reddoorz.com/robots.txt
Domain IPs 2600:1413:b000:6::17d5:2bc5, 2600:1413:b000:6::17d5:2bdc, 96.17.96.21, 96.17.96.5
Response IP 23.44.5.112
Found Yes
Hash 901c54ef5c4301a528ad2852415ffebf170469cadd96e3648d0089f63a1a0afe
SimHash aa840d8d2b70

Groups

*

Rule Path
Disallow /

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-agent: *
  • Disallow: /
  • Below is the common robots file for https://www.reddoorz.com & https://m.reddoorz.com