srimadbhagavatam.org
robots.txt

Robots Exclusion Standard data for srimadbhagavatam.org

Resource Scan

Scan Details

Site Domain srimadbhagavatam.org
Base Domain srimadbhagavatam.org
Scan Status Ok
Last Scan2025-10-06T12:31:17+00:00
Next Scan 2025-11-05T12:31:17+00:00

Last Scan

Scanned2025-10-06T12:31:17+00:00
URL https://srimadbhagavatam.org/robots.txt
Domain IPs 185.146.167.199, 2a07:7800::215
Response IP 185.146.167.199
Found Yes
Hash afc053d2942ac9e77a7349fc913a271dbd8322da57d5ea93bdc30055f6ba3e87
SimHash e920cd52efd2

Groups

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap http://cdn.attracta.com/sitemap/2369207.xml.gz
sitemap http://cdn.attracta.com/sitemap/2369208.xml.gz

Comments

  • Wildcard robots.txt agent (ask all bots to crawl slowly but still index everything).