catycan.com.ar
robots.txt

Robots Exclusion Standard data for catycan.com.ar

Resource Scan

Scan Details

Site Domain catycan.com.ar
Base Domain catycan.com.ar
Scan Status Ok
Last Scan2024-06-20T08:21:16+00:00
Next Scan 2024-07-20T08:21:16+00:00

Last Scan

Scanned2024-06-20T08:21:16+00:00
URL https://catycan.com.ar/robots.txt
Redirect https://www.catycan.com.ar/robots.txt
Redirect Domain www.catycan.com.ar
Redirect Base catycan.com.ar
Domain IPs 104.21.53.147, 172.67.213.140, 2606:4700:3037::6815:3593, 2606:4700:3037::ac43:d58c
Redirect IPs 108.157.254.5, 108.157.254.57, 108.157.254.67, 108.157.254.91, 2600:9000:2753:1200:1c:e136:8c00:93a1, 2600:9000:2753:2400:1c:e136:8c00:93a1, 2600:9000:2753:2800:1c:e136:8c00:93a1, 2600:9000:2753:6a00:1c:e136:8c00:93a1, 2600:9000:2753:8000:1c:e136:8c00:93a1, 2600:9000:2753:8600:1c:e136:8c00:93a1, 2600:9000:2753:aa00:1c:e136:8c00:93a1, 2600:9000:2753:d800:1c:e136:8c00:93a1
Response IP 108.157.254.67
Found Yes
Hash d7cc896fa2007cb07342d82219a17e7511bbe66c102deabfa4859b02e151f72b
SimHash e418cd574dd0

Groups

*

Rule Path
Disallow /img/*
Disallow /account/*
Disallow /login/*
Disallow /checkout/*
Disallow /busca/*
Disallow /quick-view/*
Disallow /espiar/*

Other Records

Field Value
sitemap https://www.natural-life.com.ar/sitemap.xml

Comments

  • Disallow all crawlers access to certain pages.

Warnings

  • `noindex` is not a known field.