talesofpanchatantra.com
robots.txt

Robots Exclusion Standard data for talesofpanchatantra.com

Resource Scan

Scan Details

Site Domain talesofpanchatantra.com
Base Domain talesofpanchatantra.com
Scan Status Ok
Last Scan7/5/2025, 2:49:25 AM
Next Scan 7/12/2025, 2:49:25 AM

Last Scan

Scanned7/5/2025, 2:49:25 AM
URL https://talesofpanchatantra.com/robots.txt
Domain IPs 184.168.101.66
Response IP 184.168.101.66
Found Yes
Hash e386f404d21fe8de9cd800fb4d257e357cb3d7d8c236d52a6143909766b3310a
SimHash aa0f31130cf1

Groups

*

Rule Path
Disallow /common/getEscapedVal.html
Disallow /data/masterdata.php

Other Records

Field Value
sitemap https://www.talesofpanchatantra.com/sitemap.xml

Comments

  • robots.txt for Site
  • Do Not delete this file.
  • Not disallowed. Crawl in there and see that there are none, get a 404 for old files, if any
  • Disallow: /*.htm$