palmers.at
robots.txt

Robots Exclusion Standard data for palmers.at

Resource Scan

Scan Details

Site Domain palmers.at
Base Domain palmers.at
Scan Status Ok
Last Scan2024-10-26T23:51:15+00:00
Next Scan 2024-11-25T23:51:15+00:00

Last Scan

Scanned2024-10-26T23:51:15+00:00
URL https://palmers.at/robots.txt
Redirect https://www.palmers.at/robots.txt
Redirect Domain www.palmers.at
Redirect Base palmers.at
Domain IPs 3.78.99.222
Redirect IPs 18.155.68.101, 18.155.68.13, 18.155.68.73, 18.155.68.92, 2600:9000:23d2:4c00:18:ed22:ef40:93a1, 2600:9000:23d2:5800:18:ed22:ef40:93a1, 2600:9000:23d2:6600:18:ed22:ef40:93a1, 2600:9000:23d2:7c00:18:ed22:ef40:93a1, 2600:9000:23d2:9e00:18:ed22:ef40:93a1, 2600:9000:23d2:ac00:18:ed22:ef40:93a1, 2600:9000:23d2:c00:18:ed22:ef40:93a1, 2600:9000:23d2:c200:18:ed22:ef40:93a1
Response IP 18.155.68.92
Found Yes
Hash f34c27d53446eed75dd19f596542f943731abf757753255fda2747ea9e27ee35
SimHash af2079d1cefb

Groups

rytebot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

*

Rule Path
Disallow /amlocator/index/ajax/
Disallow /catalogsearch/
Disallow /customer/
Disallow /checkout/
Disallow /control/
Disallow /contacts/
Disallow /customer/
Disallow /customize/
Disallow /newsletter/
Disallow /review/
Disallow /sendfriend/
Disallow /wishlist/
Disallow /poll/
Disallow /review/
Disallow /tag/
Disallow /agb/
Disallow /datenschutz/
Disallow /newsletter-confirmation/
Disallow /newsletter-unsuscribe*
Disallow /catalog/product_compare/
Disallow /?*
Disallow /cms/
Disallow /*?SID=
Disallow /*.php$
Disallow /*.git
Disallow /*.zip$
Disallow /*.sql$
Disallow /*.tgz$
Disallow /cron.php
Disallow /cron.sh
Disallow /error_log
Disallow /install.php
Disallow /LICENSE.html
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /STATUS.txt

Other Records

Field Value
sitemap https://www.palmers.at/sitemap/sitemap_palmers_de.xml
sitemap https://www.palmers.at/sitemap/sitemap_gifts_de.xml

Comments

  • Do not index session ID
  • CVS, SVN directory and dump files
  • Files