bestleanlife.com
robots.txt

Robots Exclusion Standard data for bestleanlife.com

Resource Scan

Scan Details

Site Domain bestleanlife.com
Base Domain bestleanlife.com
Scan Status Ok
Last Scan2026-01-10T05:13:59+00:00
Next Scan 2026-02-09T05:13:59+00:00

Last Scan

Scanned2026-01-10T05:13:59+00:00
URL https://bestleanlife.com/robots.txt
Domain IPs 172.66.41.35, 172.66.42.221, 2606:4700:3108::ac42:2923, 2606:4700:3108::ac42:2add
Response IP 172.66.41.35
Found Yes
Hash 1c84195970d03861618e0adf848d7db17da5bca9149708667fe4534811605653
SimHash 0154d8f2c391

Groups

archive.org_bot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20