kyivpost.com
robots.txt
Robots Exclusion Standard data for kyivpost.com
Resource Scan
Scan Details
| Site Domain | kyivpost.com |
| Base Domain | kyivpost.com |
| Scan Status | Ok |
| Last Scan | 2024-06-10T18:03:03+00:00 |
| Next Scan | 2024-06-17T18:03:03+00:00 |
Last Scan
| Scanned | 2024-06-10T18:03:03+00:00 |
| URL | https://kyivpost.com/robots.txt |
| Redirect | https://www.kyivpost.com/robots.txt |
| Redirect Domain | www.kyivpost.com |
| Redirect Base | kyivpost.com |
| Domain IPs | 104.26.14.18, 104.26.15.18, 172.67.71.53, 2606:4700:20::681a:e12, 2606:4700:20::681a:f12, 2606:4700:20::ac43:4735 |
| Redirect IPs | 104.26.14.18, 104.26.15.18, 172.67.71.53, 2606:4700:20::681a:e12, 2606:4700:20::681a:f12, 2606:4700:20::ac43:4735 |
| Response IP | 104.26.14.18 |
| Found | Yes |
| Hash | 1fd327c9a426e6dec2bd36298b9ad7ef66061adf68b73393651d66ed919e4b00 |
| SimHash | bc4988c0aa13 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /login |
| Disallow | *?s=* |
| Disallow | *post_type%3D* |
| Disallow | *?topic=* |
| Disallow | *?category=* |
| Disallow | *?type=* |
| Disallow | *?marker=* |
| Disallow | *?catname=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.kyivpost.com/sitemap.xml |