091910.com
robots.txt

Robots Exclusion Standard data for 091910.com

Resource Scan

Scan Details

Site Domain 091910.com
Base Domain 091910.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonRequest timed out.
Last Scan2024-06-12T13:57:53+00:00
Next Scan 2024-06-26T13:57:53+00:00

Last Successful Scan

Scanned2024-04-22T09:19:31+00:00
URL http://091910.com/robots.txt
Domain IPs 38.55.150.21
Response IP 38.55.150.21
Found Yes
Hash 20715414c1ca5c085d4b30ba896a9ae90a27b470ab0af2af16353199505c0943
SimHash d15ecee07a33

Groups

*

Rule Path
Disallow /d/
Disallow /e/class/
Disallow /e/config/
Disallow /e/data/
Disallow /e/update/

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

extlinksbot

Rule Path
Disallow /

hubspot

Rule Path
Disallow /

leiki

Rule Path
Disallow /

webmeup

Rule Path
Disallow /

Comments

  • robots.txt for EmpireCMS