crafter.rs
robots.txt

Robots Exclusion Standard data for crafter.rs

Resource Scan

Scan Details

Site Domain crafter.rs
Base Domain crafter.rs
Scan Status Ok
Last Scan2024-10-23T02:56:51+00:00
Next Scan 2024-11-22T02:56:51+00:00

Last Scan

Scanned2024-10-23T02:56:51+00:00
URL https://crafter.rs/robots.txt
Redirect https://www.crafter.rs/robots.txt
Redirect Domain www.crafter.rs
Redirect Base crafter.rs
Domain IPs 185.29.103.76
Redirect IPs 185.29.103.76
Response IP 185.29.103.76
Found Yes
Hash aac99e2573c924ef908e289a6b0076f9145839180b1bfb441937ceb89b78a19e
SimHash 19e24ab0c23b

Groups

*

Rule Path
Disallow /admin
Disallow /bin/
Disallow /files/
Disallow /files/exportimport/
Disallow /country/getstatesbycountryid
Disallow /install
Disallow /setproductreviewhelpfulness
Disallow /addproducttocart/catalog/
Disallow /addproducttocart/details/
Disallow /backinstocksubscriptions/manage
Disallow /boards/forumsubscriptions
Disallow /boards/forumwatch
Disallow /boards/postedit
Disallow /boards/postdelete
Disallow /boards/postcreate
Disallow /boards/topicedit
Disallow /boards/topicdelete
Disallow /boards/topiccreate
Disallow /boards/topicmove
Disallow /boards/topicwatch
Disallow /cart$
Disallow /changecurrency
Disallow /changelanguage
Disallow /changetaxtype
Disallow /checkout
Disallow /checkout/billingaddress
Disallow /checkout/completed
Disallow /checkout/confirm
Disallow /checkout/shippingaddress
Disallow /checkout/shippingmethod
Disallow /checkout/paymentinfo
Disallow /checkout/paymentmethod
Disallow /clearcomparelist
Disallow /compareproducts
Disallow /compareproducts/add/*
Disallow /customer/avatar
Disallow /customer/activation
Disallow /customer/addresses
Disallow /customer/changepassword
Disallow /customer/checkusernameavailability
Disallow /customer/downloadableproducts
Disallow /customer/info
Disallow /customer/productreviews
Disallow /deletepm
Disallow /emailwishlist
Disallow /eucookielawaccept
Disallow /inboxupdate
Disallow /newsletter/subscriptionactivation
Disallow /onepagecheckout
Disallow /order/history
Disallow /orderdetails
Disallow /passwordrecovery/confirm
Disallow /poll/vote
Disallow /privatemessages
Disallow /recentlyviewedproducts
Disallow /returnrequest
Disallow /returnrequest/history
Disallow /rewardpoints/history
Disallow /search?
Disallow /sendpm
Disallow /sentupdate
Disallow /shoppingcart/*
Disallow /storeclosed
Disallow /subscribenewsletter
Disallow /topic/authenticate
Disallow /viewpm
Disallow /uploadfilecheckoutattribute
Disallow /uploadfileproductattribute
Disallow /uploadfilereturnrequest
Disallow /wishlist
Disallow /blog/tag/
Disallow /blog/category/
Disallow /blog/month/
Disallow /*?specs=*
Disallow /intelisaleshoppingcart/ProductDetailsSpecificationDocument?*
Disallow /intelisaleshoppingcart/productdetails_attributechange?*
Disallow /autodiscover/autodiscover.xml

tinytestbot

Rule Path
Disallow /

thesis-research-bot

Rule Path
Disallow /

geedobot

Rule Path
Disallow /

geedoproductsearch

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.crafter.rs/sitemap.xml