khanpaye.com
robots.txt
Robots Exclusion Standard data for khanpaye.com
Resource Scan
Scan Details
| Site Domain | khanpaye.com |
| Base Domain | khanpaye.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-12-01T21:33:24+00:00 |
| Next Scan | 2025-12-31T21:33:24+00:00 |
Last Successful Scan
| Scanned | 2025-10-08T23:55:41+00:00 |
| URL | https://khanpaye.com/robots.txt |
| Domain IPs | 2a02:4780:15:c326:4196:b328:2038:bc52, 2a02:4780:39:4484:b7da:866a:5f21:eebe, 91.108.100.91, 93.127.201.92 |
| Response IP | 91.108.100.156 |
| Found | Yes |
| Hash | cc8ca32379892d0403ba958d15d942261a06bb3c8c2ff368ad86d09d4f89e675 |
| SimHash | c965d9c6ad1a |
Groups
*
| Rule | Path |
|---|---|
| Allow | /wp-content/uploads/ |
| Disallow | /trackback |
| Disallow | /?ref= |
| Disallow | /feed |
| Disallow | /comments/feed |
| Disallow | /feed/$ |
| Disallow | /*/feed/$ |
| Disallow | /*/feed/rss/$ |
| Disallow | /*/trackback/$ |
| Disallow | /*/*/feed/$ |
| Disallow | /*/*/feed/rss/$ |
| Disallow | /*/*/trackback/$ |
| Disallow | /*/*/*/feed/$ |
| Disallow | /*/*/*/feed/rss/$ |
| Disallow | /*/*/*/trackback/$ |
| Disallow | /?s= |
| Disallow | /?s=* |
| Disallow | /search |
| Disallow | /search* |
| Disallow | /search-* |
| Disallow | /test |
| Disallow | /test/ |
| Disallow | /*?orderby=* |
| Disallow | /wp-content/cache/ |
| Disallow | /wp-content/cache/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://khanpaye.com/sitemap_index.xml |