escrivaworks.org
robots.txt

Robots Exclusion Standard data for escrivaworks.org

Resource Scan

Scan Details

Site Domain escrivaworks.org
Base Domain escrivaworks.org
Scan Status Ok
Last Scan2024-05-28T01:41:26+00:00
Next Scan 2024-06-27T01:41:26+00:00

Last Scan

Scanned2024-05-28T01:41:26+00:00
URL https://escrivaworks.org/robots.txt
Redirect https://escriva.org/robots.txt
Redirect Domain escriva.org
Redirect Base escriva.org
Domain IPs 104.21.74.35, 172.67.197.48, 2606:4700:3032::ac43:c530, 2606:4700:3037::6815:4a23
Redirect IPs 104.26.12.221, 104.26.13.221, 172.67.75.142, 2606:4700:20::681a:cdd, 2606:4700:20::681a:ddd, 2606:4700:20::ac43:4b8e
Response IP 104.26.13.221
Found Yes
Hash 3236f6fe54cb41e59c276edda165cb64bb0d5f8cfff5ab3ae4125a17ede24482
SimHash 43fdd422eca0

Groups

*

Rule Path
Disallow /*/search/*
Disallow /*/most-visited/*
Disallow /*/wlwmanifest.xml$
Disallow /*/rss/*
Disallow /*/rss/$
Disallow /*/rss$
Disallow /rss$
Disallow /rss/$
Disallow *sitemap.xml$

bingbot

Rule Path
Disallow /*/search/*
Disallow /*/most-visited/*
Disallow /*/wlwmanifest.xml$
Disallow /*/rss/*
Disallow /*/rss/$
Disallow /*/rss$
Disallow /rss$
Disallow /rss/$
Disallow *sitemap.xml$

Other Records

Field Value
crawl-delay 10

imagesiftbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /