franchimp.com
robots.txt

Robots Exclusion Standard data for franchimp.com

Resource Scan

Scan Details

Site Domain franchimp.com
Base Domain franchimp.com
Scan Status Ok
Last Scan2026-01-21T01:13:33+00:00
Next Scan 2026-02-20T01:13:33+00:00

Last Scan

Scanned2026-01-21T01:13:33+00:00
URL https://franchimp.com/robots.txt
Redirect https://www.franchimp.com/robots.txt
Redirect Domain www.franchimp.com
Redirect Base franchimp.com
Domain IPs 104.26.10.9, 104.26.11.9, 172.67.71.103, 2606:4700:20::681a:a09, 2606:4700:20::681a:b09, 2606:4700:20::ac43:4767
Redirect IPs 104.26.10.9, 104.26.11.9, 172.67.71.103, 2606:4700:20::681a:a09, 2606:4700:20::681a:b09, 2606:4700:20::ac43:4767
Response IP 104.26.11.9
Found Yes
Hash 74adf0e985bbcf9672a2eeabe4e913cdb5e0a09d0a799210c468c5e1e59ea64b
SimHash 323faef3e452

Groups

*

Rule Path
Allow /
Disallow /api/
Disallow /admin/
Disallow /_next/
Disallow /checkout/
Disallow /cart/
Allow /images/
Allow /css/
Allow /js/

Other Records

Field Value
crawl-delay 1

gptbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

chatgpt-user

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

claude-web

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

anthropic-ai

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

perplexity-bot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

applebot-extended

Rule Path
Allow /

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 0.5

googlebot-image

Rule Path
Allow /images/

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 0.5

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.franchimp.com/sitemap-index.xml
sitemap https://www.franchimp.com/sitemap-main.xml
sitemap https://www.franchimp.com/sitemap-blog.xml
sitemap https://www.franchimp.com/sitemap-franchises.xml
sitemap https://www.franchimp.com/sitemap-fdds.xml

Comments

  • Franchimp.com robots.txt
  • Updated: 2025-11-11
  • Default crawl rules for all bots
  • Disallow certain paths to preserve crawl budget
  • Allow important assets
  • AI Crawlers - Explicitly allow for better AI visibility
  • Google specific
  • Bing specific
  • Bad bots to block
  • Sitemap location - CRITICAL FOR SEO
  • Alternative sitemaps (if using separate files)