runningdirect.de
robots.txt

Robots Exclusion Standard data for runningdirect.de

Resource Scan

Scan Details

Site Domain runningdirect.de
Base Domain runningdirect.de
Scan Status Ok
Last Scan4/7/2025, 7:50:27 AM
Next Scan 4/21/2025, 7:50:27 AM

Last Scan

Scanned4/7/2025, 7:50:27 AM
URL https://runningdirect.de/robots.txt
Redirect https://www.runningdirect.de/robots.txt
Redirect Domain www.runningdirect.de
Redirect Base runningdirect.de
Domain IPs 104.21.56.65, 172.67.179.8, 2606:4700:3030::6815:3841, 2606:4700:3035::ac43:b308
Redirect IPs 104.21.56.65, 172.67.179.8, 2606:4700:3030::6815:3841, 2606:4700:3035::ac43:b308
Response IP 172.67.179.8
Found Yes
Hash 8d82904a1094b56f6a2706dcd11f18f31af0e0278c1506244afe93e005e9e4f0
SimHash 852dfcc103f3

Groups

*

Rule Path Comment
Disallow /404/ -
Disallow /app/ -
Disallow /cgi-bin/ -
Disallow /downloader/ -
Disallow /errors/ -
Disallow /includes/ -
Disallow /lib/ -
Disallow /magento/ -
Disallow /media/captcha/ -
Disallow /media/customer/ -
Disallow /media/dhl/ -
Disallow /media/downloadable/ -
Disallow /media/import/ -
Disallow /media/sales/ -
Disallow /media/tmp/ -
Disallow /media/xmlconnect/ -
Disallow /pkginfo/ -
Disallow /report/ -
Disallow /scripts/ -
Disallow /shell/ -
Disallow /stats/ -
Disallow /var/ -
Disallow /index.php/ -
Disallow /catalog/product_compare/ -
Disallow /catalogsearch/ -
Disallow /checkout/ -
Disallow /control/ -
Disallow /contacts/ -
Disallow /customer/ -
Disallow /customize/ -
Disallow /newsletter/ -
Disallow /poll/ -
Disallow /review/ -
Disallow /sendfriend/ -
Disallow /tag/ -
Disallow /wishlist/ -
Disallow */sort-direction/* -
Disallow /ajax/* -
Disallow /ritual-covert-rucksack-9372180202934.html -
Disallow /ritual-covert-rucksack-9372180202941.html -
Disallow /ritual-covert-rucksack-9372180202927.html -
Disallow /cron.php -
Disallow /cron.sh -
Disallow /error_log -
Disallow /install.php -
Disallow /LICENSE.html -
Disallow /LICENSE.txt -
Disallow /LICENSE_AFL.txt -
Disallow /STATUS.txt -
Disallow /get.php Magento 1.5+
Disallow /*.php$ -
Disallow /*?SID= -
Disallow /rss* -
Disallow /*PHPSESSID -

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.runningdirect.nl/media/sitemap/runningdirect_nl/sitemap.xml
sitemap https://www.runningdirect.be/media/sitemap/runningdirect_be/sitemap.xml
sitemap https://www.runningdirect.de/media/sitemap/runningdirect_de/sitemap.xml
sitemap https://www.runningdirect.se/media/sitemap/runningshop_se/sitemap.xml

Comments

  • robots.txt
  • Website Sitemap
  • Crawlers Setup
  • Directories
  • Paths (clean URLs)
  • Files
  • Paths (no clean URLs)