tienda.clubpremier.com
robots.txt

Robots Exclusion Standard data for tienda.clubpremier.com

Resource Scan

Scan Details

Site Domain tienda.clubpremier.com
Base Domain clubpremier.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-09-09T13:43:50+00:00
Next Scan 2024-12-08T13:43:50+00:00

Last Successful Scan

Scanned2023-04-23T17:04:45+00:00
URL https://tienda.clubpremier.com/robots.txt
Domain IPs 104.18.157.113, 104.18.158.113, 2606:4700::6812:9d71, 2606:4700::6812:9e71
Response IP 104.18.157.113
Found Yes
Hash 9804be23a857331abd20f46fd4b4888c0c426ab22c92ece28dcacc4886f60c6a
SimHash cf3b5652cb11

Groups

yandex
sogou
turnitinbot
vebot
cliqzbot
blexbot

Rule Path
Disallow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 300

mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)
msnbot
bingbot
msnbot
msnbot-media
adidxbot
bingpreview

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /account/
Disallow /cart/
Disallow /api/
Disallow /checkout/

Other Records

Field Value
sitemap http://sitemap.linio.com/mx-cp/sitemap.xml