asia.christianlouboutin.com
robots.txt

Robots Exclusion Standard data for asia.christianlouboutin.com

Resource Scan

Scan Details

Site Domain asia.christianlouboutin.com
Base Domain christianlouboutin.com
Scan Status Ok
Last Scan2024-09-19T01:46:41+00:00
Next Scan 2024-10-19T01:46:41+00:00

Last Scan

Scanned2024-09-19T01:46:41+00:00
URL https://asia.christianlouboutin.com/robots.txt
Domain IPs 52.163.58.52
Response IP 52.163.58.52
Found Yes
Hash da9717980a065d19a4c1ee6dd4c4f0eae019f65a7798ec04ff7e52bb270a1780
SimHash b054b94d62b0

Groups

googlebot-image

Rule Path
Disallow

*

Rule Path
Disallow */404/
Disallow */app/
Disallow */cgi-bin/
Disallow */downloader/
Disallow */errors/
Disallow */includes/
Disallow */lib/
Disallow */magento/
Disallow */pkginfo/
Disallow */report/
Disallow */scripts/
Disallow */shell/
Disallow */stats/
Disallow */var/
Disallow */index.php/
Disallow */catalog/product_compare/
Disallow */catalog/category/view/
Disallow */catalog/product/view/
Disallow */catalogsearch/
Disallow */checkout/
Disallow */control/
Disallow */contacts/
Disallow */customer/
Disallow */customize/
Disallow */newsletter/
Disallow */poll/
Disallow */review/
Disallow */sendfriend/
Disallow */tag/
Disallow */wishlist/
Disallow */catalog/product/gallery/
Disallow */shop_by/
Disallow */shopby/
Disallow */cron.php
Disallow */cron.sh
Disallow */error_log
Disallow */install.php
Disallow */LICENSE.html
Disallow */LICENSE.txt
Disallow */LICENSE_AFL.txt
Disallow */STATUS.txt
Disallow */*.php$
Disallow */*?SID=

Comments

  • Google Image Crawler Setup
  • Crawlers Setup
  • Directories
  • Paths (clean URLs)
  • Files
  • Paths (no clean URLs)