Log In Sign Up

defolio.com
robots.txt

Robots Exclusion Standard data for defolio.com

Resource Scan

Scan Details

Site Domain defolio.com
Base Domain defolio.com
Scan Status Ok
Last Scan2025-09-19T15:08:00+00:00
Next Scan 2025-10-19T15:08:00+00:00

Last Scan

Scanned2025-09-19T15:08:00+00:00
URL https://defolio.com/robots.txt
Domain IPs 46.246.44.14
Response IP 46.246.44.14
Found Yes
Hash f153bc2f053b8df80e0a0398b0bd3e6b086d2966fd953bc7f2948c3adb23c31f
SimHash b68d288d6552

Groups

*

No rules defined. All paths allowed.

Back to top

Other Records

Field Value
sitemap http://defol.io/sitemap.xml.gz
Back to top

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
Back to top

Warnings

  • 5 invalid lines.
Back to top