ssdready.com
robots.txt

Robots Exclusion Standard data for ssdready.com

Resource Scan

Scan Details

Site Domain ssdready.com
Base Domain ssdready.com
Scan Status Ok
Last Scan2024-11-14T18:02:43+00:00
Next Scan 2024-11-21T18:02:43+00:00

Last Scan

Scanned2024-11-14T18:02:43+00:00
URL http://ssdready.com/robots.txt
Redirect http://www.ssdready.com/robots.txt
Redirect Domain www.ssdready.com
Redirect Base ssdready.com
Domain IPs 18.169.55.149
Redirect IPs 18.169.55.149
Response IP 18.169.55.149
Found Yes
Hash 064b93f52291c1f1ecdf12e0fbb384dc7be366567d56337b58366ea2a00dc407
SimHash 06428b81e237

Groups

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

seoengbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

seomoz

Rule Path
Disallow /

geliyoobot

Rule Path
Disallow /

voilabot

Rule Path
Disallow /

acoon

Rule Path
Disallow /

spinn3r

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-favo

Rule Path
Disallow /

baiduspider-cpro

Rule Path
Disallow /

baiduspider-ads

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

yandex

Rule Path
Disallow

*

Rule Path
Disallow /buy.php
Disallow /redirect.php
Disallow /files/*
Disallow /downloads/confirmation/*
Disallow /*.exe$
Disallow /*.msi$
Disallow /*.cab$
Disallow /*.zip$

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.