Log In Sign Up

defol.io
robots.txt

Robots Exclusion Standard data for defol.io

Resource Scan

Scan Details

Site Domain defol.io
Base Domain defol.io
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2025-09-08T17:26:08+00:00
Next Scan 2025-10-08T17:26:08+00:00

Last Successful Scan

Scanned2025-07-18T16:18:28+00:00
URL https://defol.io/robots.txt
Redirect https://defolio.com/robots.txt
Redirect Domain defolio.com
Redirect Base defolio.com
Domain IPs 104.21.94.57, 172.67.220.41, 2606:4700:3033::ac43:dc29, 2606:4700:3036::6815:5e39
Redirect IPs 46.246.44.14
Response IP 46.246.44.14
Found Yes
Hash f153bc2f053b8df80e0a0398b0bd3e6b086d2966fd953bc7f2948c3adb23c31f
SimHash b68d288d6552

Groups

*

No rules defined. All paths allowed.

Back to top

Other Records

Field Value
sitemap http://defol.io/sitemap.xml.gz
Back to top

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
Back to top

Warnings

  • 5 invalid lines.
Back to top