Log In Sign Up

automoto.cr
robots.txt

Robots Exclusion Standard data for automoto.cr

Resource Scan

Scan Details

Site Domain automoto.cr
Base Domain automoto.cr
Scan Status Ok
Last Scan2024-09-08T09:14:27+00:00
Next Scan 2024-10-08T09:14:27+00:00

Last Scan

Scanned2024-09-08T09:14:27+00:00
URL https://automoto.cr/robots.txt
Redirect https://www.automoto.cr/robots.txt
Redirect Domain www.automoto.cr
Redirect Base automoto.cr
Domain IPs 104.21.66.61, 172.67.201.133, 2606:4700:3031::ac43:c985, 2606:4700:3037::6815:423d
Redirect IPs 104.21.66.61, 172.67.201.133, 2606:4700:3031::ac43:c985, 2606:4700:3037::6815:423d
Response IP 104.21.66.61
Found Yes
Hash 2a92602e0df2ef89637b52f718de79434d5f5684e676fb6c9d7a85098f02f267
SimHash 5b924367ea29

Groups

adbeat_bot

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ahrefscrawler

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

buck

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

censysinspect

Rule Path
Disallow /

cincraw

Rule Path
Disallow /

coccocbot

Rule Path
Disallow /

daum

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

duckduckbot

Rule Path
Disallow /

duckduckgo-favicons-bot

Rule Path
Disallow /

ezinearticleslinkscanner

Rule Path
Disallow /

go-http-client

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

greenbrowser

Rule Path
Disallow /

kocmohabt

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

masscan

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

monsidobot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

netsystemsresearch

Rule Path
Disallow /

newspaper

Rule Path
Disallow /

nimbostratus-bot

Rule Path
Disallow /

obot

Rule Path
Disallow /

orbbot

Rule Path
Disallow /

pagething

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

pinterestbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

redditbot

Rule Path
Disallow /

rytebot

Rule Path
Disallow /

rsiteauditor

Rule Path
Disallow /

safednsbot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

startmebot

Rule Path
Disallow /

stormcrawler

Rule Path
Disallow /

tpradstxtcrawler

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

webdatastats

Rule Path
Disallow /

wellknownbot

Rule Path
Disallow /

wikido

Rule Path
Disallow /

woorankreview

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yeti

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

zgrab

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

*

Rule Path
Disallow /*?*specs=*&orderby=*
Disallow /*?*specs=*&pagesize=*
Disallow /*?*specs=*&pagenumber=*
Disallow /*?*specs=*%2C*%2C*
Disallow /*?*specs=*%2C*%2C*
Disallow /bin/
Disallow /content/files/
Disallow /content/files/exportimport/
Disallow /country/getstatesbycountryid
Disallow /install
Disallow /setproductreviewhelpfulness
Disallow /addproducttocart/catalog/
Disallow /addproducttocart/details/
Disallow /backinstocksubscriptions/manage
Disallow /boards/forumsubscriptions
Disallow /boards/forumwatch
Disallow /boards/postedit
Disallow /boards/postdelete
Disallow /boards/postcreate
Disallow /boards/topicedit
Disallow /boards/topicdelete
Disallow /boards/topiccreate
Disallow /boards/topicmove
Disallow /boards/topicwatch
Disallow /cart
Disallow /checkout
Disallow /checkout/billingaddress
Disallow /checkout/completed
Disallow /checkout/confirm
Disallow /checkout/shippingaddress
Disallow /checkout/shippingmethod
Disallow /checkout/paymentinfo
Disallow /checkout/paymentmethod
Disallow /clearcomparelist
Disallow /compareproducts
Disallow /compareproducts/add/*
Disallow /customer/avatar
Disallow /customer/activation
Disallow /customer/addresses
Disallow /customer/changepassword
Disallow /customer/checkusernameavailability
Disallow /customer/downloadableproducts
Disallow /customer/info
Disallow /deletepm
Disallow /emailwishlist
Disallow /inboxupdate
Disallow /newsletter/subscriptionactivation
Disallow /onepagecheckout
Disallow /order/history
Disallow /orderdetails
Disallow /passwordrecovery/confirm
Disallow /poll/vote
Disallow /privatemessages
Disallow /returnrequest
Disallow /returnrequest/history
Disallow /rewardpoints/history
Disallow /sendpm
Disallow /sentupdate
Disallow /shoppingcart/*
Disallow /subscribenewsletter
Disallow /topic/authenticate
Disallow /viewpm
Disallow /uploadfileproductattribute
Disallow /uploadfilecheckoutattribute
Disallow /wishlist
Disallow /changelanguage
Disallow /changecurrency
Disallow es/addproducttocart/catalog/
Disallow es/addproducttocart/details/
Disallow es/backinstocksubscriptions/manage
Disallow es/boards/forumsubscriptions
Disallow es/boards/forumwatch
Disallow es/boards/postedit
Disallow es/boards/postdelete
Disallow es/boards/postcreate
Disallow es/boards/topicedit
Disallow es/boards/topicdelete
Disallow es/boards/topiccreate
Disallow es/boards/topicmove
Disallow es/boards/topicwatch
Disallow es/cart
Disallow es/checkout
Disallow es/checkout/billingaddress
Disallow es/checkout/completed
Disallow es/checkout/confirm
Disallow es/checkout/shippingaddress
Disallow es/checkout/shippingmethod
Disallow es/checkout/paymentinfo
Disallow es/checkout/paymentmethod
Disallow es/clearcomparelist
Disallow es/compareproducts
Disallow es/compareproducts/add/*
Disallow es/customer/avatar
Disallow es/customer/activation
Disallow es/customer/addresses
Disallow es/customer/changepassword
Disallow es/customer/checkusernameavailability
Disallow es/customer/downloadableproducts
Disallow es/customer/info
Disallow es/deletepm
Disallow es/emailwishlist
Disallow es/inboxupdate
Disallow es/newsletter/subscriptionactivation
Disallow es/onepagecheckout
Disallow es/order/history
Disallow es/orderdetails
Disallow es/passwordrecovery/confirm
Disallow es/poll/vote
Disallow es/privatemessages
Disallow es/returnrequest
Disallow es/returnrequest/history
Disallow es/rewardpoints/history
Disallow es/sendpm
Disallow es/sentupdate
Disallow es/shoppingcart/*
Disallow es/subscribenewsletter
Disallow es/topic/authenticate
Disallow es/viewpm
Disallow es/uploadfileproductattribute
Disallow es/uploadfilecheckoutattribute
Disallow es/wishlist
Disallow es/changelanguage
Disallow es/changecurrency
Disallow en/addproducttocart/catalog/
Disallow en/addproducttocart/details/
Disallow en/backinstocksubscriptions/manage
Disallow en/boards/forumsubscriptions
Disallow en/boards/forumwatch
Disallow en/boards/postedit
Disallow en/boards/postdelete
Disallow en/boards/postcreate
Disallow en/boards/topicedit
Disallow en/boards/topicdelete
Disallow en/boards/topiccreate
Disallow en/boards/topicmove
Disallow en/boards/topicwatch
Disallow en/cart
Disallow en/checkout
Disallow en/checkout/billingaddress
Disallow en/checkout/completed
Disallow en/checkout/confirm
Disallow en/checkout/shippingaddress
Disallow en/checkout/shippingmethod
Disallow en/checkout/paymentinfo
Disallow en/checkout/paymentmethod
Disallow en/clearcomparelist
Disallow en/compareproducts
Disallow en/compareproducts/add/*
Disallow en/customer/avatar
Disallow en/customer/activation
Disallow en/customer/addresses
Disallow en/customer/changepassword
Disallow en/customer/checkusernameavailability
Disallow en/customer/downloadableproducts
Disallow en/customer/info
Disallow en/deletepm
Disallow en/emailwishlist
Disallow en/inboxupdate
Disallow en/newsletter/subscriptionactivation
Disallow en/onepagecheckout
Disallow en/order/history
Disallow en/orderdetails
Disallow en/passwordrecovery/confirm
Disallow en/poll/vote
Disallow en/privatemessages
Disallow en/returnrequest
Disallow en/returnrequest/history
Disallow en/rewardpoints/history
Disallow en/sendpm
Disallow en/sentupdate
Disallow en/shoppingcart/*
Disallow en/subscribenewsletter
Disallow en/topic/authenticate
Disallow en/viewpm
Disallow en/uploadfileproductattribute
Disallow en/uploadfilecheckoutattribute
Disallow en/wishlist
Disallow en/changelanguage
Disallow en/changecurrency
Back to top

Other Records

Field Value
sitemap http://www.automoto.cr/es/sitemap.xml
sitemap http://www.automoto.cr/en/sitemap.xml
Back to top