getseedsrighthere.com
robots.txt

Robots Exclusion Standard data for getseedsrighthere.com

Resource Scan

Scan Details

Site Domain getseedsrighthere.com
Base Domain getseedsrighthere.com
Scan Status Ok
Last Scan2025-11-29T20:53:04+00:00
Next Scan 2025-12-29T20:53:04+00:00

Last Scan

Scanned2025-11-29T20:53:04+00:00
URL https://getseedsrighthere.com/robots.txt
Domain IPs 104.26.4.178, 104.26.5.178, 172.67.75.23, 2606:4700:20::681a:4b2, 2606:4700:20::681a:5b2, 2606:4700:20::ac43:4b17
Response IP 104.26.4.178
Found Yes
Hash 283dc523a80c218ef2ca147bf887e4dfc12f85c4ff8cd297e3f200dce3da30b1
SimHash 720cdb00c621

Groups

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

ahrefsbot

Rule Path
Allow /

ahrefssiteaudit

Rule Path
Allow /

semrushbot

Rule Path
Allow /

mj12bot

Rule Path
Allow /

rogerbot

Rule Path
Allow /

python-urllib

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

curl

Rule Path
Disallow /

wget

Rule Path
Disallow /

libwww-perl

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

httrack

Rule Path
Disallow /

*

Rule Path
Disallow
Disallow /wp-content/uploads/wc-logs/
Disallow /wp-content/uploads/woocommerce_transient_files/
Disallow /wp-content/uploads/woocommerce_uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /ads.txt
Disallow /*utm_
Disallow /*fbclid%3D
Disallow /*srsltid%3D
Disallow /*gclid%3D
Disallow /*yclid%3D
Disallow /*mc_cid%3D
Disallow /*mc_eid%3D
Disallow /*ref%3D
Disallow /*affiliate%3D
Disallow /*campaignid%3D
Disallow /*_ga%3D
Disallow /*_gl%3D
Disallow /*trackid%3D
Disallow /*source%3D
Disallow /cart/?remove_item
Disallow /cart/?undo_item
Disallow /*?add-to-cart=
Disallow /*%26add-to-cart%3D
Disallow /*?product_orderby=
Disallow /*%26product_orderby%3D
Disallow /*?product_count=
Disallow /*%26product_count%3D
Disallow /*?product_view=
Disallow /*%26product_view%3D
Disallow /?s=

Other Records

Field Value
sitemap https://www.getseedsrighthere.com/sitemap_index.xml

Comments

  • Allow trusted SEO crawlers
  • Block junk bots and scrapers
  • Default rule: allow everything else
  • Exclude backend and temp files
  • Clean URL params to save crawl budget
  • Block junk WooCommerce cart actions
  • Block WooCommerce sort/filter duplicates
  • Block WordPress search
  • Sitemap declaration