cezeo.com
robots.txt

Robots Exclusion Standard data for cezeo.com

Resource Scan

Scan Details

Site Domain cezeo.com
Base Domain cezeo.com
Scan Status Ok
Last Scan2024-11-12T16:57:20+00:00
Next Scan 2024-11-19T16:57:20+00:00

Last Scan

Scanned2024-11-12T16:57:20+00:00
URL http://cezeo.com/robots.txt
Redirect http://www.cezeo.com/robots.txt
Redirect Domain www.cezeo.com
Redirect Base cezeo.com
Domain IPs 18.169.55.149
Redirect IPs 18.169.55.149
Response IP 18.169.55.149
Found Yes
Hash 293c307ee5cc2f217f392ce4e1768267ddec203723f66356d34ea85aebc47691
SimHash 06568b91c237

Groups

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

seoengbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

seomoz

Rule Path
Disallow /

geliyoobot

Rule Path
Disallow /

voilabot

Rule Path
Disallow /

acoon

Rule Path
Disallow /

spinn3r

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-favo

Rule Path
Disallow /

baiduspider-cpro

Rule Path
Disallow /

baiduspider-ads

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /buy.php
Disallow /redirect.php
Disallow /files/*
Disallow /downloads/confirmation/*
Disallow /*.exe$
Disallow /*.msi$
Disallow /*.cab$
Disallow /*.zip$

Warnings

  • `host` is not a known field.