shw.co.il
robots.txt

Robots Exclusion Standard data for shw.co.il

Resource Scan

Scan Details

Site Domain shw.co.il
Base Domain shw.co.il
Scan Status Ok
Last Scan2026-01-30T09:48:59+00:00
Next Scan 2026-03-01T09:48:59+00:00

Last Scan

Scanned2026-01-30T09:48:59+00:00
URL https://shw.co.il/robots.txt
Redirect https://www.shw.co.il/robots.txt
Redirect Domain www.shw.co.il
Redirect Base shw.co.il
Domain IPs 104.26.14.193, 104.26.15.193, 172.67.69.213, 2606:4700:20::681a:ec1, 2606:4700:20::681a:fc1, 2606:4700:20::ac43:45d5
Redirect IPs 104.26.14.193, 104.26.15.193, 172.67.69.213, 2606:4700:20::681a:ec1, 2606:4700:20::681a:fc1, 2606:4700:20::ac43:45d5
Response IP 104.26.14.193
Found Yes
Hash ddb1cceea383a5df4479e1b1030d7e4dfead2f1129fcb6f1043df35b12848f3b
SimHash 6d05eed04381

Groups

*

Rule Path
Disallow /*.Idea$
Disallow /*.Sql$
Disallow /*.Svn$
Disallow /*.Tgz$
Disallow /*?Dir*
Disallow /*?Dir=asc
Disallow /*?Dir=desc
Disallow /*?Limit=all
Disallow /*?Mode*
Disallow /*?SID=
Disallow /admin/
Disallow /ajax/
Disallow /apc.php
Disallow /api.php
Disallow /app/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /catalog/product_compare/
Disallow /catalogsearch/
Disallow /cgi-bin/
Disallow /checkout/
Disallow /checkout/cart/
Disallow /checkout/onepage/success/
Disallow /cleanup.php
Disallow /cron.php
Disallow /cron.sh
Disallow /customer/
Disallow /customer/account/
Disallow /customer/account/login/
Disallow /CVS
Disallow /downloader/
Disallow /error_log
Disallow /errors/
Disallow /get.php
Disallow /includes/
Disallow /index.php/
Disallow /install.php
Disallow /lib/
Disallow /LICENSE.html
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /memcache.php
Disallow /newsletter/manage/
Disallow /onestepcheckout/
Disallow /phpinfo.php
Disallow /pkginfo/
Disallow /README.txt
Disallow /RELEASE_NOTES.txt
Disallow /review/customer/
Disallow /sales/order/history/
Disallow /shell/
Disallow /var/
Disallow /wishlist/
Disallow /*price%3D
Disallow /*parent_color%3D
Disallow /*size%3D

barkrowler
seekportbot
dotbot
dotbot
petalbot
yandexbot
semrushbot
zoominfobot

Rule Path
Disallow /

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

applebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

amazonbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Warnings

  • 1 invalid line.