the-gyan.com
robots.txt
Robots Exclusion Standard data for the-gyan.com
Resource Scan
Scan Details
| Site Domain | the-gyan.com |
| Base Domain | the-gyan.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2025-09-01T10:20:57+00:00 |
| Next Scan | 2025-11-30T10:20:57+00:00 |
Last Successful Scan
| Scanned | 2023-08-14T10:17:31+00:00 |
| URL | https://the-gyan.com/robots.txt |
| Domain IPs | 191.101.13.158, 2a02:4780:b:1000:0:29c2:bc8a:e |
| Response IP | 191.101.13.158 |
| Found | Yes |
| Hash | 7065d42ba1beac97a3be86a17cff4cb1f57dd131783dee05b282ec668c546e44 |
| SimHash | 690188400b93 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://the-gyan.com/sitemap_index.xml |