snkr.com.kw
robots.txt

Robots Exclusion Standard data for snkr.com.kw

Resource Scan

Scan Details

Site Domain snkr.com.kw
Base Domain snkr.com.kw
Scan Status Ok
Last Scan2024-09-14T07:05:14+00:00
Next Scan 2024-09-28T07:05:14+00:00

Last Scan

Scanned2024-09-14T07:05:14+00:00
URL https://snkr.com.kw/robots.txt
Redirect https://www.snkr.com.kw/robots.txt
Redirect Domain www.snkr.com.kw
Redirect Base snkr.com.kw
Domain IPs 172.66.40.235, 172.66.43.21, 2606:4700:3108::ac42:28eb, 2606:4700:3108::ac42:2b15
Redirect IPs 172.66.40.235, 172.66.43.21, 2606:4700:3108::ac42:28eb, 2606:4700:3108::ac42:2b15
Response IP 172.66.40.235
Found Yes
Hash 5119d2c546d78c525c2943a74e399942228e67c98ec70cb007cb4dbb809642f3
SimHash b95494154598

Groups

*

Rule Path
Disallow */lib/
Disallow */*.php$
Disallow */pkginfo/
Disallow */report/
Disallow */var/
Disallow */catalog/
Disallow */customer/
Disallow */sendfriend/
Disallow */promotion/product/promotiondetails/
Disallow */wp_collection/multiwishlist/get/
Disallow */review/
Disallow */*SID%3D
Disallow */*?
Disallow */checkout/
Disallow */onestepcheckout/
Disallow */customer/
Disallow */customer/account/
Disallow */customer/account/login/
Disallow */catalogsearch/
Disallow */catalog/product_compare/
Disallow */catalog/category/view/
Disallow */catalog/product/view/
Disallow */app/
Disallow */bin/
Disallow */dev/
Disallow */lib/
Disallow */phpserver/
Disallow */pub/
Disallow */tag/
Disallow */review/
Disallow */composer.json
Disallow */composer.lock
Disallow */CONTRIBUTING.md
Disallow */CONTRIBUTOR_LICENSE_AGREEMENT.html
Disallow */COPYING.txt
Disallow */Gruntfile.js
Disallow */LICENSE.txt
Disallow */LICENSE_AFL.txt
Disallow */nginx.conf.sample
Disallow */package.json
Disallow */php.ini.sample
Disallow */RELEASE_NOTES.txt
Disallow */*?*product_list_mode=
Disallow */*?*product_list_order=
Disallow */*?*product_list_limit=
Disallow */*?*product_list_dir=
Disallow /*.git
Disallow /*.CVS
Disallow /*.Zip$
Disallow /*.Svn$
Disallow /*.Idea$
Disallow /*.Sql$
Disallow /*.Tgz$

Other Records

Field Value
sitemap https://www.snkr.com.kw/media/sitemap/snkr_sitemap.xml

Comments

  • Disable checkout & customer account
  • Disable Search pages
  • Disable common folders
  • Disable Tag & Review (Avoid duplicate content)
  • Common files
  • Disable sorting (Avoid duplicate content)
  • Disable version control folders and others