leafio.ai
robots.txt
Robots Exclusion Standard data for leafio.ai
Resource Scan
Scan Details
Site Domain | leafio.ai |
Base Domain | leafio.ai |
Scan Status | Ok |
Last Scan | 2025-09-24T04:36:35+00:00 |
Next Scan | 2025-10-24T04:36:35+00:00 |
Last Scan
Scanned | 2025-09-24T04:36:35+00:00 |
URL | https://leafio.ai/robots.txt |
Redirect | https://www.leafio.ai/robots.txt |
Redirect Domain | www.leafio.ai |
Redirect Base | leafio.ai |
Domain IPs | 104.21.59.80, 172.67.219.26, 2606:4700:3030::6815:3b50, 2606:4700:3030::ac43:db1a |
Redirect IPs | 104.21.59.80, 172.67.219.26, 2606:4700:3030::6815:3b50, 2606:4700:3030::ac43:db1a |
Response IP | 172.67.219.26 |
Found | Yes |
Hash | bc30c005c14f98e000e2a63be0294a08addc93d9a4b3864aee4e09f9f2195455 |
SimHash | 50455cb6c335 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /admin/ |
Disallow | /login/ |
Disallow | /old/ |
Disallow | */lp/ |
Disallow | /landing/ |
Disallow | /solutions/ |
Disallow | /live/ |
Disallow | /mails/ |
Disallow | /test |
Disallow | */search/ |
Disallow | */feed/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |