kp40.ru
robots.txt
Robots Exclusion Standard data for kp40.ru
Resource Scan
Scan Details
Site Domain | kp40.ru |
Base Domain | kp40.ru |
Scan Status | Ok |
Last Scan | 2024-06-01T07:52:06+00:00 |
Next Scan | 2024-06-08T07:52:06+00:00 |
Last Scan
Scanned | 2024-06-01T07:52:06+00:00 |
URL | https://kp40.ru/robots.txt |
Redirect | https://www.kp40.ru/robots.txt |
Redirect Domain | www.kp40.ru |
Redirect Base | kp40.ru |
Domain IPs | 104.21.39.134, 172.67.146.22, 2606:4700:3031::ac43:9216, 2606:4700:3034::6815:2786 |
Redirect IPs | 104.21.39.134, 172.67.146.22, 2606:4700:3031::ac43:9216, 2606:4700:3034::6815:2786 |
Response IP | 104.21.39.134 |
Found | Yes |
Hash | 3ea2b7e394239764242d363096f14c82972dca2354f58bd3b40b76980e6ba721 |
SimHash | c5317c30c493 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /cnstats/ |
Disallow | /search/ |
Disallow | /site/search/ |
Disallow | /site/cat/344/345/ |
Disallow | /site/cat/344/346/ |
Disallow | /nafisha/*%26date%3D* |
Disallow | /click/ |
Disallow | /api/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.kp40.ru/sitemap_index.xml |
Warnings
- `host` is not a known field.