Log In Sign Up

wisible.com
robots.txt

Robots Exclusion Standard data for wisible.com

Resource Scan

Scan Details

Site Domain wisible.com
Base Domain wisible.com
Scan Status Ok
Last Scan2026-03-08T12:49:31+00:00
Next Scan 2026-04-07T12:49:31+00:00

Last Scan

Scanned2026-03-08T12:49:31+00:00
URL https://wisible.com/robots.txt
Redirect https://www.wisible.com/robots.txt
Redirect Domain www.wisible.com
Redirect Base wisible.com
Domain IPs 13.214.146.202
Redirect IPs 13.214.146.202
Response IP 13.214.146.202
Found Yes
Hash 49f9b4a1927a4aca1729b87f869e03d3d8c44f73c0fceb15a02167ba0ca8d02b
SimHash 331adb3a8670

Groups

*

Rule Path
Allow /
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-login.php
Disallow /wp-register.php
Allow /wp-admin/admin-ajax.php
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /wp-content/cache/
Disallow /wp-content/uploads/wpo/
Allow /wp-content/uploads/
Disallow /xmlrpc.php
Disallow /wp-*.php
Disallow /readme.html
Disallow /license.txt
Disallow /*?s=
Disallow /*?p=
Disallow /search/
Disallow /*%26
Disallow /feed/
Disallow /comments/
Disallow /trackback/
Disallow */feed/
Disallow */comments/
Disallow */trackback/
Disallow /cart/
Disallow /checkout/
Disallow /my-account/
Disallow /wc-api/
Disallow /author/
Disallow /tag/
Allow /*.css$
Allow /*.js$
Allow /*.jpg$
Allow /*.jpeg$
Allow /*.png$
Allow /*.gif$
Allow /*.webp$

gptbot

Rule Path
Allow /

google-extended

Rule Path
Allow /

ccbot

Rule Path
Allow /

facebookbot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.wisible.com/sitemap_index.xml
sitemap https://www.wisible.com/sitemap.xml
Back to top

Comments

  • Wisible.com Robots.txt - Optimized for B2B SaaS SEO
  • Last updated: January 2026
  • ============================================
  • Global Rules - All Search Engines
  • ============================================
  • Block WordPress admin areas
  • Block WordPress technical files
  • Block unnecessary WordPress pages
  • Block search and filter parameters
  • Block duplicate content
  • Block WooCommerce/payment pages (if applicable)
  • Block author archives (prevent personal data exposure)
  • Block tag pages if not valuable for SEO
  • Allow important CSS/JS for rendering
  • ============================================
  • AI Crawlers - Strategic Control
  • ============================================
  • OpenAI GPT (ChatGPT, GPT-4)
  • Note: Allow for brand visibility in ChatGPT responses
  • See /llms.txt for structured content
  • Google AI (Gemini, Bard)
  • Allow for Google AI Search features
  • Common Crawlers (Anthropic Claude)
  • Meta AI
  • Perplexity AI
  • ============================================
  • Bad Bots - Block Aggressive Crawlers
  • ============================================
  • ============================================
  • Sitemaps
  • ============================================
  • ============================================
  • Notes for SEO Team:
  • - llms.txt available at /llms.txt (English)
  • - llms-th.txt available at /llms-th.txt (Thai)
  • - Review quarterly or after major site updates
  • - Test at: https://www.google.com/webmasters/tools/robots-testing-tool
  • ============================================
Back to top