10bestvacuums.com
robots.txt

Robots Exclusion Standard data for 10bestvacuums.com

Resource Scan

Scan Details

Site Domain 10bestvacuums.com
Base Domain 10bestvacuums.com
Scan Status Ok
Last Scan2026-02-10T04:38:24+00:00
Next Scan 2026-03-12T04:38:24+00:00

Last Scan

Scanned2026-02-10T04:38:24+00:00
URL https://10bestvacuums.com/robots.txt
Domain IPs 104.21.83.71, 172.67.217.46, 2606:4700:3030::6815:5347, 2606:4700:3035::ac43:d92e
Response IP 104.21.83.71
Found Yes
Hash 0bc01649c8e52697fb8914a5ff63792e147431b367975ddb39078944b0655cb6
SimHash 601f5b506061

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /cgi-bin/
Disallow /search
Disallow /private/
Disallow /login
Disallow /register
Disallow /account/
Disallow /user/
Disallow /author/*/feed/
Allow /wp-content/uploads/
Allow /images/
Allow /photos/
Allow /media/
Allow /css/
Allow /js/
Allow /assets/
Allow /reviews/
Allow /articles/
Allow /guides/
Allow /comparisons/
Allow /best-of/
Allow /how-to/
Allow /buying-guides/
Disallow /*?print=
Disallow /*?sort=
Disallow /*?filter=
Disallow /*?utm_
Disallow /*?ref=
Disallow /*?fbclid=
Disallow /*?gclid=
Disallow /*?page=*&
Disallow /tag/*/feed/
Disallow /category/*/feed/
Disallow /*/trackback/
Disallow /*/comments/feed/
Disallow /feed/
Disallow /comments/feed/
Disallow /xmlrpc.php
Disallow /wp-*.php
Disallow /readme.html
Disallow /license.txt

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Rule Path
Allow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://10bestvacuums.com/sitemap_index.xml

Comments

  • Robots.txt for https://10bestvacuums.com/
  • Review and Info Site - Last updated: September 2025
  • ==============================
  • Global Rules
  • ==============================
  • Allow access to important content
  • ==============================
  • Duplicate & Tracking Parameters
  • ==============================
  • ==============================
  • WordPress Core Files
  • ==============================
  • ==============================
  • Beneficial Bots
  • ==============================
  • ==============================
  • Block Aggressive Crawlers
  • ==============================
  • ==============================
  • Block AI Scrapers
  • ==============================
  • ==============================
  • Crawl Delay
  • ==============================
  • ==============================
  • Sitemap
  • ==============================