ielts-assistant.com
robots.txt

Robots Exclusion Standard data for ielts-assistant.com

Resource Scan

Scan Details

Site Domain ielts-assistant.com
Base Domain ielts-assistant.com
Scan Status Ok
Last Scan2025-12-22T09:37:45+00:00
Next Scan 2026-01-21T09:37:45+00:00

Last Scan

Scanned2025-12-22T09:37:45+00:00
URL https://ielts-assistant.com/robots.txt
Domain IPs 80.79.124.3
Response IP 80.79.124.3
Found Yes
Hash 54ab25484331de685e8d6007fd81f136609c66b4b35b2bf9f8013473298d20fb
SimHash c04ec8598dd1

Groups

*

Rule Path
Allow /

googlebot

Rule Path
Allow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://your-domain.com/sitemap.xml

Comments

  • Specific rules for Googlebot (optional - already covered by * above)
  • Block only problematic bots if needed
  • Sitemap location