leaf.expert
robots.txt

Robots Exclusion Standard data for leaf.expert

Resource Scan

Scan Details

Site Domain leaf.expert
Base Domain leaf.expert
Scan Status Ok
Last Scan2025-10-20T17:11:30+00:00
Next Scan 2025-10-27T17:11:30+00:00

Last Scan

Scanned2025-10-20T17:11:30+00:00
URL https://leaf.expert/robots.txt
Domain IPs 104.21.50.147, 172.67.207.4, 2606:4700:3031::6815:3293, 2606:4700:3034::ac43:cf04
Response IP 172.67.207.4
Found Yes
Hash 0379ab23628a56bbd984a24cca9ff6404f82451c748ec33d62e817122a6b7da3
SimHash 085d9cd787c2

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /trackback
Disallow */trackback
Disallow */*/trackback
Disallow */*/feed/*/
Disallow */feed

ahrefsbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

waybackmachine

Rule Path
Disallow /

iaarchiver

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

Other Records

Field Value
sitemap https://leaf.expert/sitemap_index.xml