Log In Sign Up

tijusacademy.com
robots.txt

Robots Exclusion Standard data for tijusacademy.com

Resource Scan

Scan Details

Site Domain tijusacademy.com
Base Domain tijusacademy.com
Scan Status Ok
Last Scan2026-03-21T22:39:42+00:00
Next Scan 2026-04-20T22:39:42+00:00

Last Scan

Scanned2026-03-21T22:39:42+00:00
URL https://tijusacademy.com/robots.txt
Domain IPs 104.21.89.130, 172.67.189.72, 2606:4700:3030::6815:5982, 2606:4700:3037::ac43:bd48
Response IP 172.67.189.72
Found Yes
Hash 08f1bb052de9be9e3bb1a114352fa83cec5a3fdc658348b1469f2d41cadf21ee
SimHash 763cf942232a

Groups

*

Rule Path
Allow /
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /wp-content/themes/*/assets/
Disallow /wp-json/
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /*?replytocom=*
Disallow /*?s=*
Disallow /*?p=*
Disallow /*%26preview%3Dtrue*
Disallow /cgi-bin/
Disallow /trackback/
Disallow /feed/
Disallow /comments/feed/
Disallow /*/feed/
Disallow /*/comments/feed/
Disallow /tag/*/feed/
Disallow /category/*/feed/
Disallow /author/
Disallow /?s=
Disallow /search/
Disallow /cart/
Disallow /checkout/
Disallow /my-account/
Disallow /cdn-cgi/

googlebot

Rule Path
Allow /
Allow /wp-content/uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-includes/
Disallow /wp-login.php

googlebot-image

Rule Path
Allow /wp-content/uploads/
Allow /courses/
Allow /gallery/
Disallow /wp-includes/

bingbot

Rule Path
Allow /
Allow /wp-content/uploads/
Disallow /wp-admin/
Disallow /wp-includes/

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

perplexity-user

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://tijusacademy.com/sitemap_index.xml
sitemap https://tijusacademy.com/sitemap.xml
Back to top

Comments

  • robots.txt for tijusacademy.com
  • Tiju's Academy - OET, IELTS, PTE, CBT, NCLEX-RN & More
  • Last updated: March 2026
  • =============================================
  • Default rules for all crawlers
  • =============================================
  • WordPress core directories to block
  • Block query parameters (duplicate content)
  • Block internal/admin pages
  • Block WordPress author archives (thin content)
  • Block internal search results
  • Block cart/checkout if WooCommerce is used
  • Block CDN/email protection paths
  • =============================================
  • Google Bot specific rules
  • =============================================
  • =============================================
  • Google Image Bot
  • =============================================
  • =============================================
  • Bing Bot
  • =============================================
  • =============================================
  • Block AI training crawlers
  • =============================================
  • =============================================
  • Block aggressive/unwanted bots
  • =============================================
  • =============================================
  • Sitemap
  • =============================================
  • =============================================
  • Crawl-delay for less important bots
  • =============================================
Back to top