palmers-shop.com
robots.txt

Robots Exclusion Standard data for palmers-shop.com

Resource Scan

Scan Details

Site Domain palmers-shop.com
Base Domain palmers-shop.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonRequest timed out.
Last Scan2024-04-15T13:12:33+00:00
Next Scan 2024-07-14T13:12:33+00:00

Last Successful Scan

Scanned2023-11-25T06:17:33+00:00
URL https://palmers-shop.com/robots.txt
Redirect https://www.palmers.at/robots.txt
Redirect Domain www.palmers.at
Redirect Base palmers.at
Domain IPs 35.158.167.249
Redirect IPs 13.33.33.118, 13.33.33.50, 13.33.33.55, 13.33.33.76
Response IP 52.222.149.12
Found Yes
Hash 640f03ad4efc28e2432270befafee0513bffdaa05653053c60959c124b7b56b5
SimHash af6051d18bfb

Groups

rytebot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

*

Rule Path
Disallow /amlocator/index/ajax/
Disallow /catalogsearch/
Disallow /customer/
Disallow /checkout/
Disallow /control/
Disallow /contacts/
Disallow /customer/
Disallow /customize/
Disallow /newsletter/
Disallow /review/
Disallow /sendfriend/
Disallow /wishlist/
Disallow /poll/
Disallow /review/
Disallow /tag/
Disallow /agb/
Disallow /datenschutz/
Disallow /newsletter-confirmation/
Disallow /newsletter-unsuscribe*
Disallow /catalog/product_compare/
Disallow /?*
Disallow /cms/
Disallow /*?SID=
Disallow /*.php$
Disallow /*.git
Disallow /*.zip$
Disallow /*.sql$
Disallow /*.tgz$
Disallow /cron.php
Disallow /cron.sh
Disallow /error_log
Disallow /install.php
Disallow /LICENSE.html
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /STATUS.txt

Other Records

Field Value
sitemap https://www.palmers.at/media/sitemap/sitemap.xml
sitemap https://www.p2.com/media/sitemap/sitemap_p2.xml

Comments

  • Do not index session ID
  • CVS, SVN directory and dump files
  • Files