politobzor.net
robots.txt
Robots Exclusion Standard data for politobzor.net
Resource Scan
Scan Details
Site Domain | politobzor.net |
Base Domain | politobzor.net |
Scan Status | Ok |
Last Scan | 2024-11-14T21:54:04+00:00 |
Next Scan | 2024-11-21T21:54:04+00:00 |
Last Scan
Scanned | 2024-11-14T21:54:04+00:00 |
URL | https://politobzor.net/robots.txt |
Domain IPs | 104.21.78.136, 172.67.222.104, 2606:4700:3031::6815:4e88, 2606:4700:3035::ac43:de68 |
Response IP | 172.67.222.104 |
Found | Yes |
Hash | c3c41f398efce9472f5a1ccfa1d6249e0cab4d0533750195e6853f3d860e2418 |
SimHash | 6b080ce66e13 |
Groups
*
Rule | Path |
---|---|
Disallow | /engine/go.php |
Disallow | /engine/download.php |
Disallow | /newposts/ |
Disallow | /statistics.html |
Disallow | /*subaction%3D |
Disallow | /*action%3D |
Disallow | /*do%3D |
Disallow | /*user/ |
Disallow | /*index.php? |
Disallow | /print%3Apage* |
Disallow | /*print% |
Disallow | /page%2C* |
Disallow | /admin.php |
Disallow | /*?cstart= |
Other Records
Field | Value |
---|---|
sitemap | https://politobzor.net/sitemap.xml |
Warnings
- `host` is not a known field.