astrojyotishi.com
robots.txt

Robots Exclusion Standard data for astrojyotishi.com

Resource Scan

Scan Details

Site Domain astrojyotishi.com
Base Domain astrojyotishi.com
Scan Status Ok
Last Scan2026-03-14T01:56:22+00:00
Next Scan 2026-04-13T01:56:22+00:00

Last Scan

Scanned2026-03-14T01:56:22+00:00
URL https://astrojyotishi.com/robots.txt
Domain IPs 92.204.70.15
Response IP 92.204.70.15
Found Yes
Hash 25aab06cad706322cec0c2dc0252bcfb681154942028c19a5e786dd8bba44820
SimHash 2e67d19355cc

Groups

*

Rule Path
Disallow /11111/
Disallow /cgi-bin/
Disallow /privatedir/
Disallow /Clients/
Disallow /card/
Disallow /muddy/
Disallow /tutorials/blank.htm
Disallow /Services-forms/
Disallow /Register/
Disallow /ap/

ia_archiver

Rule Path
Disallow

teoma

Rule Path
Disallow

googlebot

Rule Path
Disallow

msnbot

Rule Path
Disallow

slurp

Rule Path
Disallow

abachobot

Rule Path
Disallow

fireball

Rule Path
Disallow

voilabot

Rule Path
Disallow

yandex

Rule Path
Disallow

*

Rule Path
Disallow

Comments

  • Alexa
  • Ask
  • Google
  • MSN
  • Yahoo!
  • Abacho
  • Fireball
  • Voila.fr
  • Yandex
  • Others