tabletennis11.fr
robots.txt

Robots Exclusion Standard data for tabletennis11.fr

Resource Scan

Scan Details

Site Domain tabletennis11.fr
Base Domain tabletennis11.fr
Scan Status Ok
Last Scan2024-09-13T05:32:27+00:00
Next Scan 2024-10-13T05:32:27+00:00

Last Scan

Scanned2024-09-13T05:32:27+00:00
URL https://tabletennis11.fr/robots.txt
Redirect https://www.tabletennis11.fr/robots.txt
Redirect Domain www.tabletennis11.fr
Redirect Base tabletennis11.fr
Domain IPs 104.26.4.41, 104.26.5.41, 172.67.73.232, 2606:4700:20::681a:429, 2606:4700:20::681a:529, 2606:4700:20::ac43:49e8
Redirect IPs 104.26.4.41, 104.26.5.41, 172.67.73.232, 2606:4700:20::681a:429, 2606:4700:20::681a:529, 2606:4700:20::ac43:49e8
Response IP 104.26.4.41
Found Yes
Hash 6f1df907d1a4b3cad3ba1fb5a574f2587b4aa7342030c1fd40eca87fc41f63a4
SimHash a9145dd182b9

Groups

googlebot-image

Rule Path
Disallow /other_fr/
Disallow /eur_fr/
Disallow /est_ee/
Disallow /est_eng/
Disallow /eur_eng/

siege

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

amazonbot

Rule Path
Disallow */404/
Disallow */app/
Disallow */cgi-bin/
Disallow */downloader/
Disallow */errors/
Disallow */includes/
Disallow */magento/
Disallow */pkginfo/
Disallow */report/
Disallow */scripts/
Disallow */shell/
Disallow */skin/
Disallow */stats/
Disallow */var
Disallow */index.php/
Disallow */catalog/product_compare/
Disallow */catalog/category/view/
Disallow */catalog/product/view/
Disallow */catalogsearch/
Disallow */control/
Disallow */contacts/
Disallow */customer/
Disallow */customize/
Disallow */newsletter/
Disallow */poll/
Disallow */review/
Disallow */sendfriend/
Disallow */tag/
Disallow */wishlist/
Disallow */catalog/product/gallery/
Disallow */order
Disallow /cron.php
Disallow /cron.sh
Disallow /error_log
Disallow /install.php
Disallow /LICENSE.html
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /STATUS.txt
Disallow /*.php$
Disallow /*?SID=

Other Records

Field Value
crawl-delay 20

Comments

  • Google Image Crawler Setup
  • Crawlers Setup
  • Directories
  • Disallow: /js/
  • Disallow: /lib/
  • Disallow: /media/
  • Paths (clean URLs)
  • Disallow: /checkout/
  • Files
  • Paths (no clean URLs)
  • Disallow: /*.js$
  • Disallow: /*.css$