vidyarthiplus.com
robots.txt

Robots Exclusion Standard data for vidyarthiplus.com

Resource Scan

Scan Details

Site Domain vidyarthiplus.com
Base Domain vidyarthiplus.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-03T04:38:14+00:00
Next Scan 2026-01-10T04:38:14+00:00

Last Successful Scan

Scanned2025-12-26T04:37:57+00:00
URL https://vidyarthiplus.com/robots.txt
Domain IPs 2a02:4780:84:3394:bf6f:7f3b:302b:3e43, 2a02:4780:84:5d14:b46:deb4:2cf0:eb5b, 77.37.75.251, 93.127.201.42
Response IP 91.108.100.50
Found Yes
Hash ba41abe0c820be5bfa18cc4c5e17f0a86a810e628a30700033194e21df376fdf
SimHash 0adc9ae3a5a2

Groups

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow

googlebot

Rule Path
Allow /study/
Disallow /study/search.php
Disallow /study/printthread.php
Disallow /study/online.php
Disallow /study/memberlist.php
Disallow /study/calendar.php
Disallow /study/private.php
Disallow /study/usercp.php
Disallow /study/modcp.php
Disallow /study/newreply.php
Disallow /study/newthread.php
Disallow /study/*mode%3D*
Disallow /study/*sort%3D*
Disallow /study/*order%3D*
Disallow /study/*datecut%3D*
Disallow /study/*action%3D*
Disallow /study/captcha.php
Disallow /study/editpost.php

*

Rule Path
Disallow /admin
Disallow /support
Disallow /test
Disallow /go
Disallow /link
Disallow /tcpdf
Disallow /mm
Disallow /csp
Disallow /internal
Allow /study/

Other Records

Field Value
sitemap https://vidyarthiplus.com/study/sitemap.xml

Comments

  • ----------------------------
  • BLOCK HEAVY SEO & SCRAPER BOTS
  • ----------------------------
  • ----------------------------
  • ALLOW GOOGLE ADS BOT (CRITICAL)
  • ----------------------------
  • ----------------------------
  • GOOGLEBOT – INDEX ONLY REAL TOPIC PAGES
  • ----------------------------
  • ----------------------------
  • ALL OTHER BOTS
  • ----------------------------
  • ----------------------------
  • SITEMAP
  • ----------------------------