zooplus.bg
robots.txt

Robots Exclusion Standard data for zooplus.bg

Resource Scan

Scan Details

Site Domain zooplus.bg
Base Domain zooplus.bg
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-08T02:32:32+00:00
Next Scan 2024-09-06T02:32:32+00:00

Last Successful Scan

Scanned2022-11-05T06:17:03+00:00
URL https://zooplus.bg/robots.txt
Response IP 54.192.111.66, 54.192.111.16, 54.192.111.9, 54.192.111.23
Found Yes
Hash 5a32c39614c732353c9f24cab616a2ee4d8e2ef1f769a2769487b6e4296c0d7a
SimHash 60805e4589f1

Groups

*

Rule Path
Disallow /ov?
Disallow /detailedQuestion.htm$

bingbot

Rule Path
Disallow /ov?
Disallow /detailedQuestion.htm$

Other Records

Field Value
crawl-delay 5

msnbot

Rule Path
Disallow /ov?
Disallow /detailedQuestion.htm$

Other Records

Field Value
crawl-delay 5

msnbot-media

Rule Path
Disallow /ov?
Disallow /detailedQuestion.htm$

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.zooplus.bg/info/sitemap.xml
sitemap https://www.zooplus.bg/bg/l2/sitemap.xml
sitemap https://www.zooplus.bg/bg/l3/sitemap.xml
sitemap https://www.zooplus.bg/bg/l4/sitemap.xml
sitemap https://www.zooplus.bg/bg/details/sitemap.xml

Comments

  • robots txt for zooplus
  • created 07.10.2019