cafearte.bg
robots.txt

Robots Exclusion Standard data for cafearte.bg

Resource Scan

Scan Details

Site Domain cafearte.bg
Base Domain cafearte.bg
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-22T22:03:14+00:00
Next Scan 2026-04-22T22:03:14+00:00

Last Successful Scan

Scanned2024-04-03T19:25:35+00:00
URL https://cafearte.bg/robots.txt
Domain IPs 185.76.65.131
Response IP 185.76.65.131
Found Yes
Hash 2f0db697ca79580456139e21876b6e5e07c203acb401de2d06ed7f2106ea9cae
SimHash ed1fdb74cc30

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://cafearte.bg/calyculusixt.xml
sitemap https://cafearte.bg/neozoicwxz.xml
sitemap https://cafearte.bg/baiaoqtp.xml
sitemap https://cafearte.bg/lunatumjgx.xml
sitemap https://cafearte.bg/tithonusldn.xml
sitemap https://cafearte.bg/cooperantknk.xml
sitemap https://cafearte.bg/phytosociologyzwm.xml
sitemap https://cafearte.bg/fourmilezom.xml
sitemap https://cafearte.bg/costaricakmk.xml
sitemap https://cafearte.bg/noblestwuh.xml
sitemap https://cafearte.bg/neumarkari.xml
sitemap https://cafearte.bg/biostrainbvu.xml
sitemap https://cafearte.bg/galionjicbe.xml
sitemap https://cafearte.bg/decalcifierxpc.xml
sitemap https://cafearte.bg/hamantaschenxmc.xml
sitemap https://cafearte.bg/sitemap.xml