business-gazeta.ru
robots.txt
Robots Exclusion Standard data for business-gazeta.ru
Resource Scan
Scan Details
Site Domain | business-gazeta.ru |
Base Domain | business-gazeta.ru |
Scan Status | Ok |
Last Scan | 2024-06-05T05:14:12+00:00 |
Next Scan | 2024-06-12T05:14:12+00:00 |
Last Scan
Scanned | 2024-06-05T05:14:12+00:00 |
URL | https://business-gazeta.ru/robots.txt |
Redirect | https://www.business-gazeta.ru/robots.txt |
Redirect Domain | www.business-gazeta.ru |
Redirect Base | business-gazeta.ru |
Domain IPs | 178.248.239.234 |
Redirect IPs | 178.248.239.234 |
Response IP | 178.248.239.234 |
Found | Yes |
Hash | bc9b04d1c8af6b111f1c89ff87c427b71b92281debd0544302a34cd06c538f81 |
SimHash | 7051d8e3f791 |
Groups
*
Rule | Path |
---|---|
Disallow | /print/* |
Disallow | /text/* |
Disallow | /images/* |
Disallow | /cgi-bin/* |
Disallow | /search/* |
Disallow | /auth/* |
Disallow | /my/* |
Disallow | /me/* |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.