horticulturesource.com
robots.txt

Robots Exclusion Standard data for horticulturesource.com

Resource Scan

Scan Details

Site Domain horticulturesource.com
Base Domain horticulturesource.com
Scan Status Ok
Last Scan2024-10-01T06:29:28+00:00
Next Scan 2024-10-08T06:29:28+00:00

Last Scan

Scanned2024-10-01T06:29:28+00:00
URL https://horticulturesource.com/robots.txt
Domain IPs 162.159.136.54, 162.159.137.54
Response IP 162.159.137.54
Found Yes
Hash f111259887be0d2eb7263c97847184815c7c1ad7c8f3a039abf448ec423cac70
SimHash 7d475c01b2d4

Groups

*

Rule Path
Disallow /admin/
Disallow *wp-admin*
Disallow *wp-settings.php
Disallow *xmlrpc.php
Disallow *wp-mail.php
Disallow /inst/
Disallow /includes/
Disallow /tmp/
Disallow /cgi-bin/
Disallow /download/
Disallow /ext/
Disallow /extras/
Disallow /GeoIp/
Disallow /pdf/
Disallow /cache/
Disallow /linkex/data/
Disallow /chat/
Disallow /forum/
Disallow /cache/
Disallow /dojo/
Disallow /sitemap_gen-1.4/
Disallow /paypal_ipn/
Disallow /paypal_ipn-x/
Disallow /googlecheckout/
Disallow /async-content.php*
Disallow /404.php*
Disallow /paypal_ipn*
Disallow /account.php*
Disallow /checkout_shipping.php*
Disallow /create_account.php*
Disallow /login.php*
Disallow /password_forgotten.php*
Disallow /shopping_cart.php*
Disallow /product_reviews_write.php*
Disallow /cookie_usage.php*
Disallow /searchsuggest.php*
Disallow /y_key*
Disallow /yahoo*
Disallow /error_log*
Disallow /google*
Disallow /kjh*
Disallow /index-*
Disallow /test.*
Disallow /temp.*
Disallow *kjh*
Disallow *error_log*
Disallow /backup.*
Disallow *.backup
Disallow *.bak
Disallow *.old
Disallow *.last
Disallow *.kjh
Disallow *.cache
Disallow *.new
Disallow *.gc
Disallow *.working
Disallow *.160
Disallow *.as
Disallow *.cgi
Disallow *.cp
Disallow *.csv
Disallow *.cvsignore
Disallow *.db
Disallow *.ec
Disallow *.ex
Disallow *.fla
Disallow *.gz
Disallow *.htaccess
Disallow *.htpasswd
Disallow *.ics
Disallow *.rtf
Disallow *.pl
Disallow *.jbf
Disallow *.json
Disallow *.log
Disallow *.opml
Disallow *.psd
Disallow *.sh
Disallow *.smd
Disallow *.sql
Disallow *.svg
Disallow *.swf
Disallow *.txt
Disallow *.inc
Disallow *.xsl
Disallow *.doc
Disallow *.xls

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.horticulturesource.com/fresh/sitemap_index.xml

Comments

  • Request-rate: 1/10
  • Sitemap: http://www.horticulturesource.com/sitemap_index.xml
  • Disallow: /javascript/
  • Disallow: *-gc
  • Disallow: *.js
  • (c) Usisu, Inc.