spec-komp.com
robots.txt
Robots Exclusion Standard data for spec-komp.com
Resource Scan
Scan Details
Site Domain | spec-komp.com |
Base Domain | spec-komp.com |
Scan Status | Ok |
Last Scan | 2025-10-15T11:48:26+00:00 |
Next Scan | 2025-10-22T11:48:26+00:00 |
Last Scan
Scanned | 2025-10-15T11:48:26+00:00 |
URL | https://spec-komp.com/robots.txt |
Domain IPs | 104.21.36.201, 172.67.199.72, 2606:4700:3031::ac43:c748, 2606:4700:3035::6815:24c9 |
Response IP | 172.67.199.72 |
Found | Yes |
Hash | f39b23464fa7b136f645b333cccccde4579e1af4b7b00e215ee8306cfda73415 |
SimHash | ed250505cf83 |
Groups
*
Rule | Path |
---|---|
Disallow | /a/ |
Disallow | /stat/ |
Disallow | /index/1 |
Disallow | /index/3 |
Disallow | /index/5 |
Disallow | /index/7 |
Disallow | /index/8 |
Disallow | /index/9 |
Disallow | /panel/ |
Disallow | /admin/ |
Disallow | /secure/ |
Disallow | /mchat/ |
Disallow | /index/sub/ |
Disallow | /board/ |
Disallow | /search/ |
Disallow | /gb/ |
Disallow | /?ssid= |
Disallow | /gor/ |
Disallow | /publ/ |
Disallow | /test.html |
Disallow | /tor/ |
Disallow | /publ/ |
Disallow | /dir/ |
Disallow | /*?* |
Disallow | /_ld/ |
Disallow | /*-987* |
Disallow | /*?_escaped_fragment_=* |
Disallow | /shop/ |
Disallow | /faq/ |
Disallow | /register/ |
Disallow | /register |
Disallow | /*?q=* |
Disallow | /*search* |
Disallow | /lib/ |
Disallow | /zlib/ |
Disallow | /utils/ |
Disallow | /adler32 |
Disallow | /crc32 |
Disallow | /trees |
Disallow | /common |
Allow | /news/rssya_zen |
Other Records
Field | Value |
---|---|
sitemap | https://spec-komp.com/sitemap.xml |
Warnings
- `host` is not a known field.