escriva.org
robots.txt

Robots Exclusion Standard data for escriva.org

Resource Scan

Scan Details

Site Domain escriva.org
Base Domain escriva.org
Scan Status Ok
Last Scan2024-05-20T02:04:36+00:00
Next Scan 2024-06-19T02:04:36+00:00

Last Scan

Scanned2024-05-20T02:04:36+00:00
URL https://escriva.org/robots.txt
Domain IPs 104.26.12.221, 104.26.13.221, 172.67.75.142, 2606:4700:20::681a:cdd, 2606:4700:20::681a:ddd, 2606:4700:20::ac43:4b8e
Response IP 172.67.75.142
Found Yes
Hash 3236f6fe54cb41e59c276edda165cb64bb0d5f8cfff5ab3ae4125a17ede24482
SimHash 43fdd422eca0

Groups

*

Rule Path
Disallow /*/search/*
Disallow /*/most-visited/*
Disallow /*/wlwmanifest.xml$
Disallow /*/rss/*
Disallow /*/rss/$
Disallow /*/rss$
Disallow /rss$
Disallow /rss/$
Disallow *sitemap.xml$

bingbot

Rule Path
Disallow /*/search/*
Disallow /*/most-visited/*
Disallow /*/wlwmanifest.xml$
Disallow /*/rss/*
Disallow /*/rss/$
Disallow /*/rss$
Disallow /rss$
Disallow /rss/$
Disallow *sitemap.xml$

Other Records

Field Value
crawl-delay 10

imagesiftbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /