jon-divens.com
robots.txt

Robots Exclusion Standard data for jon-divens.com

Resource Scan

Scan Details

Site Domain jon-divens.com
Base Domain jon-divens.com
Scan Status Ok
Last Scan2024-11-09T18:01:59+00:00
Next Scan 2024-12-09T18:01:59+00:00

Last Scan

Scanned2024-11-09T18:01:59+00:00
URL https://www.jon-divens.com/robots.txt
Domain IPs 18.155.68.125, 18.155.68.39, 18.155.68.58, 18.155.68.83, 2600:9000:2816:1200:12:d6f2:a400:93a1, 2600:9000:2816:3a00:12:d6f2:a400:93a1, 2600:9000:2816:3e00:12:d6f2:a400:93a1, 2600:9000:2816:4200:12:d6f2:a400:93a1, 2600:9000:2816:8a00:12:d6f2:a400:93a1, 2600:9000:2816:a400:12:d6f2:a400:93a1, 2600:9000:2816:b800:12:d6f2:a400:93a1, 2600:9000:2816:ee00:12:d6f2:a400:93a1
Response IP 18.155.68.83
Found Yes
Hash 0221ca33afda3959e81ac377e5aa591667a78ef3c314e1f29fbe53948c12e98a
SimHash 68304b226333

Groups

*

Rule Path
Disallow

Comments

  • www.robotstxt.org/
  • Allow crawling of all content