atarkasher.co.il
robots.txt

Robots Exclusion Standard data for atarkasher.co.il

Resource Scan

Scan Details

Site Domain atarkasher.co.il
Base Domain atarkasher.co.il
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-21T20:19:51+00:00
Next Scan 2024-12-20T20:19:51+00:00

Last Successful Scan

Scanned2023-11-20T19:38:57+00:00
URL https://www.atarkasher.co.il/robots.txt
Domain IPs 13.107.213.59, 13.107.246.59, 2620:1ec:46::59, 2620:1ec:bdf::59
Response IP 13.107.246.57
Found Yes
Hash 1bae26e6ed116fd6d3504b4245bc9ebfdb24fc4d51a0edeedb28c304d1f4f5ac
SimHash a41db159dbd1

Groups

*

Rule Path
Disallow /reshomesite/
Disallow /compAdmin/
Disallow /compadmin/
Disallow /ResHome/
Disallow /reshome/
Disallow /Account/
Disallow /account/
Disallow /Moneycard/
Disallow /moneycard/
Disallow /Restaurants/Search/
Disallow /restaurants/search/
Disallow /Restaurants/Discounts
Disallow /restaurants/discounts
Disallow /catering/Restaurants/Search/
Disallow /catering/restaurants/search/
Disallow /next/restaurants/search/
Disallow /next/en/restaurants/search/
Disallow /next/user-report/
Disallow /next/en/user-report/
Disallow /next/checkout/
Disallow /next/en/checkout/
Disallow /next/order-success/
Disallow /next/en/order-success/
Disallow /next/signin/
Disallow /next/en/signin/
Disallow /next/update-user-details/
Disallow /next/en/update-user-details/
Disallow /next/link-money-card-request/
Disallow /next/en/link-money-card-request/
Disallow /next/coupons/
Disallow /next/en/coupons/

Other Records

Field Value
sitemap https://www.10bis.co.il/sitemap.xml

Comments

  • only US-ASCII characters are allowed
  • according to Google's robots.txt specification, file paths are definitely case-sensitive
  • Google needs to be able to render the page completely, including the JavaScript and CSS
  • to ensure that the page is mobile-friendly
  • https://moz.com/blog/why-all-seos-should-unblock-js-css
  • Disallow: /Content/* # contains css / images / js files
  • Disallow: /Scripts/* # contains js files