onoff.ge
robots.txt

Robots Exclusion Standard data for onoff.ge

Resource Scan

Scan Details

Site Domain onoff.ge
Base Domain onoff.ge
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-12T18:56:16+00:00
Next Scan 2025-11-10T18:56:16+00:00

Last Successful Scan

Scanned2024-12-23T18:54:19+00:00
URL https://onoff.ge/robots.txt
Domain IPs 104.26.6.210, 104.26.7.210, 172.67.73.33, 2606:4700:20::681a:6d2, 2606:4700:20::681a:7d2, 2606:4700:20::ac43:4921
Response IP 172.67.73.33
Found Yes
Hash 5be16148773378df3421b919cafd31993ddeab728c9662530ca4f6efd5540977
SimHash 29a04b30cb27

Groups

*

Rule Path
Allow /
Disallow /admin
Disallow /bin/
Disallow /files/
Disallow /files/exportimport/
Disallow /country/getstatesbycountryid
Disallow /install
Disallow /setproductreviewhelpfulness
Disallow /addproducttocart/catalog/
Disallow /addproducttocart/details/
Disallow /backinstocksubscriptions/manage
Disallow /boards/forumsubscriptions
Disallow /boards/forumwatch
Disallow /boards/postedit
Disallow /boards/postdelete
Disallow /boards/postcreate
Disallow /boards/topicedit
Disallow /boards/topicdelete
Disallow /boards/topiccreate
Disallow /boards/topicmove
Disallow /boards/topicwatch
Disallow /cart
Disallow /checkout
Disallow /checkout/billingaddress
Disallow /checkout/completed
Disallow /checkout/confirm
Disallow /checkout/shippingaddress
Disallow /checkout/shippingmethod
Disallow /checkout/paymentinfo
Disallow /checkout/paymentmethod
Disallow /clearcomparelist
Disallow /compareproducts
Disallow /compareproducts/add/*
Disallow /customer/avatar
Disallow /customer/activation
Disallow /customer/addresses
Disallow /customer/changepassword
Disallow /customer/checkusernameavailability
Disallow /customer/downloadableproducts
Disallow /customer/info
Disallow /deletepm
Disallow /emailwishlist
Disallow /inboxupdate
Disallow /newsletter/subscriptionactivation
Disallow /onepagecheckout
Disallow /order/history
Disallow /orderdetails
Disallow /passwordrecovery/confirm
Disallow /poll/vote
Disallow /privatemessages
Disallow /returnrequest
Disallow /returnrequest/history
Disallow /rewardpoints/history
Disallow /sendpm
Disallow /sentupdate
Disallow /shoppingcart/*
Disallow /storeclosed
Disallow /subscribenewsletter
Disallow /topic/authenticate
Disallow /viewpm
Disallow /uploadfilecheckoutattribute
Disallow /uploadfileproductattribute
Disallow /uploadfilereturnrequest
Disallow /wishlist

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://onoff.ge/sitemap.xml

Comments

  • Allow all user agents to crawl everything
  • Specify the location of the sitemap
  • Disallow specific directories and URLs
  • Specify crawl delay (optional)