shathayu.com
robots.txt

Robots Exclusion Standard data for shathayu.com

Resource Scan

Scan Details

Site Domain shathayu.com
Base Domain shathayu.com
Scan Status Ok
Last Scan2024-06-10T11:23:04+00:00
Next Scan 2024-07-10T11:23:04+00:00

Last Scan

Scanned2024-06-10T11:23:04+00:00
URL https://shathayu.com/robots.txt
Domain IPs 2a02:4780:84:2a47:6880:4f99:b7bb:ad09, 93.127.187.8
Response IP 93.127.201.54
Found Yes
Hash 4222ee2a302a7806440e28ebec9529454e9e82b09db5bcb80e70a61affe88fe1
SimHash 6d10d0d6c635

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://shathayu.com/sitemap.xml