anyleaf.org
robots.txt

Robots Exclusion Standard data for anyleaf.org

Resource Scan

Scan Details

Site Domain anyleaf.org
Base Domain anyleaf.org
Scan Status Ok
Last Scan2025-08-02T06:44:18+00:00
Next Scan 2025-09-01T06:44:18+00:00

Last Scan

Scanned2025-08-02T06:44:18+00:00
URL https://anyleaf.org/robots.txt
Redirect https://www.anyleaf.org/robots.txt
Redirect Domain www.anyleaf.org
Redirect Base anyleaf.org
Domain IPs 198.185.159.145
Redirect IPs 13.248.132.87, 35.71.145.101, 75.2.97.79, 99.83.151.71
Response IP 13.248.132.87
Found Yes
Hash 58fdece6d291ffff7b7d44de25d9fc07e3ef29c125b7fb9a79a9db449c8c122d
SimHash 4c094cc0c1b5

Groups

*

Rule Path
Disallow /admin
Disallow /*.txt

yandex

Rule Path
Disallow /admin

Other Records

Field Value
crawl-delay 3

googlebot

Rule Path
Disallow /admin

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://example.com/sitemap.xml

Warnings

  • `host` is not a known field.