zooplus.no
robots.txt

Robots Exclusion Standard data for zooplus.no

Resource Scan

Scan Details

Site Domain zooplus.no
Base Domain zooplus.no
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-06-18T16:46:55+00:00
Next Scan 2025-07-02T16:46:55+00:00

Last Successful Scan

Scanned2025-05-27T16:46:28+00:00
URL https://zooplus.no/robots.txt
Domain IPs 13.226.2.103, 13.226.2.39, 13.226.2.49, 13.226.2.68
Response IP 3.164.68.94
Found Yes
Hash 9d710e25d04e795aa6bd6c00cca20f821ec865d2b3e67af405b2f23ba088fd37
SimHash 62e1fb45cdf5

Groups

*

Rule Path
Disallow /ov?
Disallow /detailedQuestion.htm$

bingbot

Rule Path
Disallow /ov?
Disallow /detailedQuestion.htm$

Other Records

Field Value
crawl-delay 5

msnbot

Rule Path
Disallow /ov?
Disallow /detailedQuestion.htm$

Other Records

Field Value
crawl-delay 5

msnbot-media

Rule Path
Disallow /ov?
Disallow /detailedQuestion.htm$

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.zooplus.no/info/sitemap.xml
sitemap https://www.zooplus.no/no/l2/sitemap.xml
sitemap https://www.zooplus.no/no/l3/sitemap.xml
sitemap https://www.zooplus.no/no/l4/sitemap.xml
sitemap https://www.zooplus.no/no/details/sitemap.xml
sitemap https://www.zooplus.no/magasin/sitemap/post-sitemap.xml
sitemap https://www.zooplus.no/magasin/sitemap/page-sitemap.xml

Comments

  • robots txt for zooplus
  • created 07.10.2019