hinduwebsite.com
robots.txt

Robots Exclusion Standard data for hinduwebsite.com

Resource Scan

Scan Details

Site Domain hinduwebsite.com
Base Domain hinduwebsite.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-13T19:27:16+00:00
Next Scan 2026-03-13T19:27:16+00:00

Last Successful Scan

Scanned2024-08-21T19:25:00+00:00
URL https://hinduwebsite.com/robots.txt
Domain IPs 172.66.40.79, 172.66.43.177, 2606:4700:3108::ac42:284f, 2606:4700:3108::ac42:2bb1
Response IP 172.66.40.79
Found Yes
Hash 5cbbe946d25d7514faee79ffb4e4ce24c19ab890ace152b26050faf419a82e76
SimHash 1b685e60fec0

Groups

ahrefsbot

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /cgi-bin/
Disallow /tmp/
Disallow /private/
Disallow /adScripts/
Disallow /aspnet_Client/
Disallow /Includes/
Disallow /xhtIncludes/
Disallow /bookreviews/Includes/
Disallow /divinelife/Includes/
Disallow /general/Includes/
Disallow /general/popups/
Disallow /products/rss/
Disallow /sacredscripts/includes/
Disallow /scripts/
Disallow /selfdevt/includes/
Disallow /selfdevt/commercial/
Disallow /shopping/popups/
Disallow /utilities/includes/

Warnings

  • `host` is not a known field.