busca.es.directory
robots.txt

Robots Exclusion Standard data for busca.es.directory

Resource Scan

Scan Details

Site Domain busca.es.directory
Base Domain es.directory
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-12-19T18:37:14+00:00
Next Scan 2026-03-19T18:37:14+00:00

Last Successful Scan

Scanned2023-02-09T19:19:29+00:00
URL https://busca.es.directory/robots.txt
Domain IPs 104.21.18.151, 172.67.182.159, 2606:4700:3032::6815:1297, 2606:4700:3033::ac43:b69f
Response IP 172.67.182.159
Found Yes
Hash e7b4376c15cb934f9fa3a60434fc2746f851bcf1d968b0528eef8813bb84b630
SimHash 0914dcd2c2d2

Groups

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 60

archiver.org_bot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

Other Records

Field Value
sitemap https://busca.es.directory/sitemap.xml