tabletennis11.com
robots.txt

Robots Exclusion Standard data for tabletennis11.com

Resource Scan

Scan Details

Site Domain tabletennis11.com
Base Domain tabletennis11.com
Scan Status Ok
Last Scan2024-05-09T01:33:30+00:00
Next Scan 2024-06-08T01:33:30+00:00

Last Scan

Scanned2024-05-09T01:33:30+00:00
URL https://tabletennis11.com/robots.txt
Redirect https://www.tabletennis11.com/robots.txt
Redirect Domain www.tabletennis11.com
Redirect Base tabletennis11.com
Domain IPs 104.26.4.133, 104.26.5.133, 172.67.74.128, 2606:4700:20::681a:485, 2606:4700:20::681a:585, 2606:4700:20::ac43:4a80
Redirect IPs 104.26.4.133, 104.26.5.133, 172.67.74.128, 2606:4700:20::681a:485, 2606:4700:20::681a:585, 2606:4700:20::ac43:4a80
Response IP 104.26.5.133
Found Yes
Hash 6f1df907d1a4b3cad3ba1fb5a574f2587b4aa7342030c1fd40eca87fc41f63a4
SimHash a9145dd182b9

Groups

googlebot-image

Rule Path
Disallow /other_fr/
Disallow /eur_fr/
Disallow /est_ee/
Disallow /est_eng/
Disallow /eur_eng/

siege

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

amazonbot

Rule Path
Disallow */404/
Disallow */app/
Disallow */cgi-bin/
Disallow */downloader/
Disallow */errors/
Disallow */includes/
Disallow */magento/
Disallow */pkginfo/
Disallow */report/
Disallow */scripts/
Disallow */shell/
Disallow */skin/
Disallow */stats/
Disallow */var
Disallow */index.php/
Disallow */catalog/product_compare/
Disallow */catalog/category/view/
Disallow */catalog/product/view/
Disallow */catalogsearch/
Disallow */control/
Disallow */contacts/
Disallow */customer/
Disallow */customize/
Disallow */newsletter/
Disallow */poll/
Disallow */review/
Disallow */sendfriend/
Disallow */tag/
Disallow */wishlist/
Disallow */catalog/product/gallery/
Disallow */order
Disallow /cron.php
Disallow /cron.sh
Disallow /error_log
Disallow /install.php
Disallow /LICENSE.html
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /STATUS.txt
Disallow /*.php$
Disallow /*?SID=

Other Records

Field Value
crawl-delay 20

Comments

  • Google Image Crawler Setup
  • Crawlers Setup
  • Directories
  • Disallow: /js/
  • Disallow: /lib/
  • Disallow: /media/
  • Paths (clean URLs)
  • Disallow: /checkout/
  • Files
  • Paths (no clean URLs)
  • Disallow: /*.js$
  • Disallow: /*.css$