rawlinspaints.com
robots.txt

Robots Exclusion Standard data for rawlinspaints.com

Resource Scan

Scan Details

Site Domain rawlinspaints.com
Base Domain rawlinspaints.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-17T23:11:27+00:00
Next Scan 2024-12-16T23:11:27+00:00

Last Successful Scan

Scanned2024-04-28T16:07:40+00:00
URL https://rawlinspaints.com/robots.txt
Domain IPs 172.66.41.18, 172.66.42.238, 2606:4700:3108::ac42:2912, 2606:4700:3108::ac42:2aee
Response IP 172.66.42.238
Found Yes
Hash 638c3efdd5c910259b582e2b32576717af63cf62d72d5fffa92465ba364e386b
SimHash 580f280f4715

Groups

*

Rule Path
Allow */modules/*.css
Allow */modules/*.js
Allow */modules/*.png
Allow */modules/*.jpg
Allow */themes/*/assets/cache/*.js
Allow */themes/*/assets/cache/*.css
Allow */themes/*/assets/css/*
Disallow /tag/*
Disallow /author/*
Disallow /category/*
Disallow /best-sales
Disallow /new-products
Disallow /order
Disallow /my-account
Disallow /*.PDF$
Disallow /faqs/*
Disallow /faqs
Disallow /search*
Disallow /dev
Disallow /*?order=
Disallow /*?tag=
Disallow /*?id_currency=
Disallow /*?search_query=
Disallow /*?back=
Disallow /*?n=
Disallow /*%26order%3D
Disallow /*%26tag%3D
Disallow /*%26id_currency%3D
Disallow /*%26search_query%3D
Disallow /*%26back%3D
Disallow /*%26n%3D
Disallow /*controller%3Daddresses
Disallow /*controller%3Daddress
Disallow /*controller%3Dauthentication
Disallow /*controller%3Dcart
Disallow /*controller%3Ddiscount
Disallow /*controller%3Dfooter
Disallow /*controller%3Dget-file
Disallow /*controller%3Dheader
Disallow /*controller%3Dhistory
Disallow /*controller%3Didentity
Disallow /*controller%3Dimages.inc
Disallow /*controller%3Dinit
Disallow /*controller%3Dmy-account
Disallow /*controller%3Dorder
Disallow /*controller%3Dorder-slip
Disallow /*controller%3Dorder-detail
Disallow /*controller%3Dorder-follow
Disallow /*controller%3Dorder-return
Disallow /*controller%3Dorder-confirmation
Disallow /*controller%3Dpagination
Disallow /*controller%3Dpassword
Disallow /*controller%3Dpdf-invoice
Disallow /*controller%3Dpdf-order-return
Disallow /*controller%3Dpdf-order-slip
Disallow /*controller%3Dproduct-sort
Disallow /*controller%3Dsearch
Disallow /*controller%3Dstatistics
Disallow /*controller%3Dattachment
Disallow /*controller%3Dguest-tracking
Disallow */cache/
Disallow */classes/
Disallow */config/
Disallow */controllers/
Disallow */css/
Disallow */download/
Disallow */js/
Disallow */localization/
Disallow */log/
Disallow */mails/
Disallow */modules/
Disallow */override/
Disallow */pdf/
Disallow */src/
Disallow */tools/
Disallow */translations/
Disallow */upload/
Disallow */vendor/
Disallow */web/
Disallow */webservice/
Disallow /*en/password-recovery
Disallow /*en/address
Disallow /*en/addresses
Disallow /*en/login
Disallow /*en/cart
Disallow /*en/discount
Disallow /*en/order-history
Disallow /*en/identity
Disallow /*en/my-account
Disallow /*en/order-follow
Disallow /*en/credit-slip
Disallow /*en/order
Disallow /*en/search
Disallow /*en/guest-tracking
Disallow /*en/order-confirmation
Disallow /*gb/password-recovery
Disallow /*gb/address
Disallow /*gb/addresses
Disallow /*gb/login
Disallow /*gb/cart
Disallow /*gb/discount
Disallow /*gb/order-history
Disallow /*gb/identity
Disallow /*gb/my-account
Disallow /*gb/order-follow
Disallow /*gb/credit-slip
Disallow /*gb/order
Disallow /*gb/search
Disallow /*gb/guest-tracking
Disallow /*gb/order-confirmation

Other Records

Field Value
crawl-delay 10

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.rawlinspaints.com/module/lgsitemaps/sitemap?fc=module&name=sitemap_1
sitemap https://www.rawlinspaints.com/blog/sitemap_index.xml

Comments

  • robots.txt automatically generated by PrestaShop e-commerce open-source solution
  • http://www.prestashop.com - http://www.prestashop.com/forums
  • This file is to prevent the crawling and indexing of certain parts
  • of your site by web crawlers and spiders run by sites like Yahoo!
  • and Google. By telling these "robots" where not to go on your site,
  • you save bandwidth and server resources.
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/robotstxt.html
  • Allow Directives
  • Private pages
  • Directories
  • Files
  • Block MegaIndex.ru

Warnings

  • 4 invalid lines.