astrokundli.net
robots.txt
Robots Exclusion Standard data for astrokundli.net
Resource Scan
Scan Details
Site Domain | astrokundli.net |
Base Domain | astrokundli.net |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-10-01T11:36:15+00:00 |
Next Scan | 2024-10-08T11:36:15+00:00 |
Last Successful Scan
Scanned | 2024-09-23T11:35:53+00:00 |
URL | https://astrokundli.net/robots.txt |
Domain IPs | 2a02:4780:11:1021:0:26de:cec9:4, 89.117.188.253 |
Response IP | 89.117.188.253 |
Found | Yes |
Hash | c5c6603ad152f76b5286cc634adbb3bb73cb092e6516de6f8abcfe387b8f6a7d |
SimHash | 4b0d6543e0a0 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Allow | /wp-admin/admin-ajax.php |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://astrokundli.net/sitemap_index.xml |