Log In Sign Up

4me-demo.com
robots.txt

Robots Exclusion Standard data for 4me-demo.com

Resource Scan

Scan Details

Site Domain 4me-demo.com
Base Domain 4me-demo.com
Scan Status Ok
Last Scan2024-07-02T13:32:54+00:00
Next Scan 2024-07-16T13:32:54+00:00

Last Scan

Scanned2024-07-02T13:32:54+00:00
URL https://4me-demo.com/robots.txt
Domain IPs 107.23.120.246, 2600:1f18:1c2f:c001:b4c4:ba1d:dc58:b008, 2600:1f18:1c2f:c002:ac1a:c325:d7fc:1b58, 2600:1f18:1c2f:c003:f6ca:7128:591d:dab3, 3.224.106.154, 34.197.91.43
Response IP 107.23.120.246
Found Yes
Hash d33d930009a4d7b87b1dd01e1521a2e70554af463bae0b91d529a3dd094c9c79
SimHash ba840d8d6370

Groups

*

Rule Path
Disallow /
Back to top

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
Back to top