dooz.com
robots.txt

Robots Exclusion Standard data for dooz.com

Resource Scan

Scan Details

Site Domain dooz.com
Base Domain dooz.com
Scan Status Ok
Last Scan2024-10-29T05:58:48+00:00
Next Scan 2024-11-05T05:58:48+00:00

Last Scan

Scanned2024-10-29T05:58:48+00:00
URL https://dooz.com/robots.txt
Domain IPs 108.156.133.124, 108.156.133.128, 108.156.133.28, 108.156.133.87
Response IP 108.156.133.28
Found Yes
Hash d80b34dd651ffd872cddb1ce7717eeceda319993a386133a767b70ab0284c01a
SimHash 04147402c783

Groups

robozilla

Rule Path
Disallow /

nutch

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

psbot

Rule Path
Disallow /

*

Rule Path
Disallow
Disallow /cgi-bin/