escrivaworks.org.br
robots.txt

Robots Exclusion Standard data for escrivaworks.org.br

Resource Scan

Scan Details

Site Domain escrivaworks.org.br
Base Domain escrivaworks.org.br
Scan Status Ok
Last Scan2024-06-09T21:23:19+00:00
Next Scan 2024-07-09T21:23:19+00:00

Last Scan

Scanned2024-06-09T21:23:19+00:00
URL https://escrivaworks.org.br/robots.txt
Redirect https://escriva.org/robots.txt
Redirect Domain escriva.org
Redirect Base escriva.org
Domain IPs 104.21.37.146, 172.67.209.110, 2606:4700:3033::6815:2592, 2606:4700:3035::ac43:d16e
Redirect IPs 104.26.12.221, 104.26.13.221, 172.67.75.142, 2606:4700:20::681a:cdd, 2606:4700:20::681a:ddd, 2606:4700:20::ac43:4b8e
Response IP 104.26.13.221
Found Yes
Hash 3236f6fe54cb41e59c276edda165cb64bb0d5f8cfff5ab3ae4125a17ede24482
SimHash 43fdd422eca0

Groups

*

Rule Path
Disallow /*/search/*
Disallow /*/most-visited/*
Disallow /*/wlwmanifest.xml$
Disallow /*/rss/*
Disallow /*/rss/$
Disallow /*/rss$
Disallow /rss$
Disallow /rss/$
Disallow *sitemap.xml$

bingbot

Rule Path
Disallow /*/search/*
Disallow /*/most-visited/*
Disallow /*/wlwmanifest.xml$
Disallow /*/rss/*
Disallow /*/rss/$
Disallow /*/rss$
Disallow /rss$
Disallow /rss/$
Disallow *sitemap.xml$

Other Records

Field Value
crawl-delay 10

imagesiftbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /