Log In Sign Up

hismith.com
robots.txt

Robots Exclusion Standard data for hismith.com

Resource Scan

Scan Details

Site Domain hismith.com
Base Domain hismith.com
Scan Status Ok
Last Scan2025-09-29T11:23:24+00:00
Next Scan 2025-10-29T11:23:24+00:00

Last Scan

Scanned2025-09-29T11:23:24+00:00
URL https://hismith.com/robots.txt
Domain IPs 208.109.36.84
Response IP 208.109.36.84
Found Yes
Hash 961bc6d0b19f2a40db5b85be3fa50d7b8bec3160e3d2d38849879a215285dce5
SimHash de46b8da871d

Groups

seekportbot

Rule Path
Disallow /

duckduckbot

Rule Path
Disallow /

duckassistbot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

twitterbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

geedoproductsearch

Rule Path
Disallow /

amazonproductdiscovery

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

photon

Rule Path
Disallow /

applebot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

naver

Rule Path
Disallow /

daum bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

haosouspider

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

majestic seo

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

searchmetrics

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

sistrix crawler

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

sitebulb

Rule Path
Disallow /

ravencrawler

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

adscanner

Rule Path
Disallow /

builtwith

Rule Path
Disallow /

ninjabot

Rule Path
Disallow /

deepcrawl

Rule Path
Disallow /

*

Rule Path
Allow */modules/*.css
Allow */modules/*.js
Allow */modules/*.png
Allow */modules/*.jpg
Allow /js/jquery/*
Disallow /*?order=
Disallow /*?tag=
Disallow /*?id_currency=
Disallow /*?search_query=
Disallow /*?back=
Disallow /*?n=
Disallow /*%26order%3D
Disallow /*%26tag%3D
Disallow /*%26id_currency%3D
Disallow /*%26search_query%3D
Disallow /*%26back%3D
Disallow /*%26n%3D
Disallow /*controller%3Daddresses
Disallow /*controller%3Daddress
Disallow /*controller%3Dauthentication
Disallow /*controller%3Dcart
Disallow /*controller%3Ddiscount
Disallow /*controller%3Dfooter
Disallow /*controller%3Dget-file
Disallow /*controller%3Dheader
Disallow /*controller%3Dhistory
Disallow /*controller%3Didentity
Disallow /*controller%3Dimages.inc
Disallow /*controller%3Dinit
Disallow /*controller%3Dmy-account
Disallow /*controller%3Dorder
Disallow /*controller%3Dorder-slip
Disallow /*controller%3Dorder-detail
Disallow /*controller%3Dorder-follow
Disallow /*controller%3Dorder-return
Disallow /*controller%3Dorder-confirmation
Disallow /*controller%3Dpagination
Disallow /*controller%3Dpassword
Disallow /*controller%3Dpdf-invoice
Disallow /*controller%3Dpdf-order-return
Disallow /*controller%3Dpdf-order-slip
Disallow /*controller%3Dproduct-sort
Disallow /*controller%3Dsearch
Disallow /*controller%3Dstatistics
Disallow /*controller%3Dattachment
Disallow /*controller%3Dguest-tracking
Disallow /app/
Disallow /cache/
Disallow /classes/
Disallow /config/
Disallow /controllers/
Disallow /download/
Disallow /js/
Disallow /localization/
Disallow /log/
Disallow /mails/
Disallow /modules/
Disallow /override/
Disallow /pdf/
Disallow /src/
Disallow /tools/
Disallow /translations/
Disallow /upload/
Disallow /var/
Disallow /vendor/
Disallow /webservice/
Disallow /en/app/
Disallow /en/cache/
Disallow /en/classes/
Disallow /en/config/
Disallow /en/controllers/
Disallow /en/download/
Disallow /en/js/
Disallow /en/localization/
Disallow /en/log/
Disallow /en/mails/
Disallow /en/modules/
Disallow /en/override/
Disallow /en/pdf/
Disallow /en/src/
Disallow /en/tools/
Disallow /en/translations/
Disallow /en/upload/
Disallow /en/var/
Disallow /en/vendor/
Disallow /en/webservice/
Disallow /tw/app/
Disallow /tw/cache/
Disallow /tw/classes/
Disallow /tw/config/
Disallow /tw/controllers/
Disallow /tw/download/
Disallow /tw/js/
Disallow /tw/localization/
Disallow /tw/log/
Disallow /tw/mails/
Disallow /tw/modules/
Disallow /tw/override/
Disallow /tw/pdf/
Disallow /tw/src/
Disallow /tw/tools/
Disallow /tw/translations/
Disallow /tw/upload/
Disallow /tw/var/
Disallow /tw/vendor/
Disallow /tw/webservice/
Disallow /zh/app/
Disallow /zh/cache/
Disallow /zh/classes/
Disallow /zh/config/
Disallow /zh/controllers/
Disallow /zh/download/
Disallow /zh/js/
Disallow /zh/localization/
Disallow /zh/log/
Disallow /zh/mails/
Disallow /zh/modules/
Disallow /zh/override/
Disallow /zh/pdf/
Disallow /zh/src/
Disallow /zh/tools/
Disallow /zh/translations/
Disallow /zh/upload/
Disallow /zh/var/
Disallow /zh/vendor/
Disallow /zh/webservice/
Disallow /*en/password-recovery
Disallow /*en/address
Disallow /*en/addresses
Disallow /*en/login
Disallow /*en/cart
Disallow /*en/discount
Disallow /*en/order-history
Disallow /*en/identity
Disallow /*en/my-account
Disallow /*en/order-follow
Disallow /*en/credit-slip
Disallow /*en/order
Disallow /*en/search
Disallow /*en/guest-tracking
Disallow /*en/order-confirmation
Disallow /*tw/password-recovery
Disallow /*tw/address
Disallow /*tw/addresses
Disallow /*tw/login
Disallow /*tw/cart
Disallow /*tw/discount
Disallow /*tw/order-history
Disallow /*tw/identity
Disallow /*tw/my-account
Disallow /*tw/order-follow
Disallow /*tw/credit-slip
Disallow /*tw/order
Disallow /*tw/search
Disallow /*tw/guest-tracking
Disallow /*tw/order-confirmation
Disallow /*zh/password-recovery
Disallow /*zh/address
Disallow /*zh/addresses
Disallow /*zh/login
Disallow /*zh/cart
Disallow /*zh/discount
Disallow /*zh/order-history
Disallow /*zh/identity
Disallow /*zh/my-account
Disallow /*zh/order-follow
Disallow /*zh/credit-slip
Disallow /*zh/order
Disallow /*zh/search
Disallow /*zh/guest-tracking
Disallow /*zh/order-confirmation
Back to top

Comments

  • robots.txt automatically generated by PrestaShop e-commerce open-source solution
  • https://www.prestashop.com - https://www.prestashop.com/forums
  • This file is to prevent the crawling and indexing of certain parts
  • of your site by web crawlers and spiders run by sites like Yahoo!
  • and Google. By telling these "robots" where not to go on your site,
  • you save bandwidth and server resources.
  • For more information about the robots.txt standard, see:
  • https://www.robotstxt.org/robotstxt.html
  • Googlebot specific rules
  • User-agent: Googlebot
  • Crawl-delay: 10
  • Allow: /
  • User-agent: Googlebot-Image
  • Disallow: /
  • User-agent: AhrefsBot
  • Crawl-delay: 10
  • Disallow: /
  • User-agent: AhrefsSiteAudit
  • Crawl-delay: 10
  • Disallow: /
  • User-agent: Storebot-Google
  • Disallow: /
  • Allow Directives
  • Private pages
  • Directories for newsexmachine.com
  • Files
Back to top

Warnings

  • 2 invalid lines.
Back to top