zooplus.pl
robots.txt

Robots Exclusion Standard data for zooplus.pl

Resource Scan

Scan Details

Site Domain zooplus.pl
Base Domain zooplus.pl
Scan Status Ok
Last Scan2025-03-12T21:57:49+00:00
Next Scan 2025-03-26T21:57:49+00:00

Last Scan

Scanned2025-03-12T21:57:49+00:00
URL https://zooplus.pl/robots.txt
Domain IPs 3.169.71.21, 3.169.71.24, 3.169.71.8, 3.169.71.92
Response IP 18.165.122.6
Found Yes
Hash 8196bc4e9743f854b932e1d4a336af20a7f817e3728b5cee7df6a4334f4446ea
SimHash 670929518135

Groups

*

Rule Path
Disallow /askdetail?
Disallow /miva/
Disallow /postcards/*
Disallow /recommendation/
Disallow /bonuspoints/
Disallow /ov?
Disallow /specials/
Disallow /content/jobs/
Disallow /detailedQuestion.htm$

bingbot

Rule Path
Disallow /askdetail?
Disallow /miva/
Disallow /postcards/*
Disallow /recommendation/
Disallow /bonuspoints/
Disallow /ov?
Disallow /specials/
Disallow /content/jobs/
Disallow /detailedQuestion.htm$

Other Records

Field Value
crawl-delay 5

msnbot

Rule Path
Disallow /askdetail?
Disallow /miva/
Disallow /postcards/*
Disallow /recommendation/
Disallow /bonuspoints/
Disallow /ov?
Disallow /specials/
Disallow /content/jobs/
Disallow /detailedQuestion.htm$

Other Records

Field Value
crawl-delay 5

msnbot-media

Rule Path
Disallow /askdetail?
Disallow /miva/
Disallow /postcards/*
Disallow /recommendation/
Disallow /bonuspoints/
Disallow /ov?
Disallow /specials/
Disallow /content/jobs/
Disallow /detailedQuestion.htm$

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.zooplus.pl/info/sitemap.xml
sitemap https://www.zooplus.pl/pl/l2/sitemap.xml
sitemap https://www.zooplus.pl/pl/l3/sitemap.xml
sitemap https://www.zooplus.pl/pl/l4/sitemap.xml
sitemap https://www.zooplus.pl/pl/details/sitemap.xml
sitemap https://www.zooplus.pl/magazyn/sitemap/post-sitemap.xml
sitemap https://www.zooplus.pl/magazyn/sitemap/page-sitemap.xml

Comments

  • robots.txt for zooplus
  • created 08.10.2019