i4a.com
robots.txt

Robots Exclusion Standard data for i4a.com

Resource Scan

Scan Details

Site Domain i4a.com
Base Domain i4a.com
Scan Status Ok
Last Scan2026-01-07T19:46:07+00:00
Next Scan 2026-02-06T19:46:07+00:00

Last Scan

Scanned2026-01-07T19:46:07+00:00
URL https://i4a.com/robots.txt
Redirect https://www.i4a.com/robots.txt
Redirect Domain www.i4a.com
Redirect Base i4a.com
Domain IPs 203.23.244.63
Redirect IPs 203.23.244.63
Response IP 203.23.244.63
Found Yes
Hash 1d3a4e0fda7eaf7900398e4d1109ff4c2c2fc42e828601a98becdf5a7142ad03
SimHash 386e8dd2af1e

Groups

*

Rule Path
Allow /
Allow /*.css
Allow /*.js
Allow /*.jpg
Allow /*.jpeg
Allow /*.png
Allow /*.gif
Allow /*.webp
Allow /*.svg
Disallow /resources/association-cost-calculator/submit.cfm
Disallow /resources/association-cost-calculator/thank-you/
Disallow /resources/amc-budget-calculator/submit/
Disallow /resources/membership-retention-rate-calculator/print-reports/
Disallow /contact/submit.cfm
Disallow /contact/thank-you.cfm
Disallow /admin/
Disallow /private/
Disallow /project-docs/
Disallow /custom/
Disallow /i4a/
Disallow /_ai/

ahrefsbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

mj12bot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

semrushbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

semrushbot-bm

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

siteauditbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

semrushbot-si

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

rogerbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

dotbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

piplbot

Rule Path
Disallow /

teleport

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

mercator-2.0

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

polybot

Rule Path
Disallow /

pjspider

Rule Path
Disallow /

wfarc

Rule Path
Disallow /

crescent internet toolpak http ole control v.1.0

Rule Path
Disallow /

guidebot/5.3

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

orbbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.i4a.com/sitemap_index.xml

Comments

  • robots.txt for i4a Association Management Software
  • Sitemap location
  • =============================================================================
  • DEFAULT RULES FOR ALL CRAWLERS
  • =============================================================================
  • Allow CSS, JS, and images for proper rendering
  • Disallow utility/form submission pages
  • Disallow admin, backend, and internal paths
  • =============================================================================
  • SEO TOOLS - EXPLICITLY ALLOWED (for backlink & site audit data)
  • =============================================================================
  • Ahrefs - backlink analysis and SEO metrics
  • Majestic - backlink analysis
  • Semrush bots - SEO auditing and competitive analysis
  • Moz - Domain Authority and backlink analysis
  • =============================================================================
  • BLOCKED BOTS - Scrapers, spammers, and unwanted crawlers
  • =============================================================================