bpwbrest.by
robots.txt
Robots Exclusion Standard data for bpwbrest.by
Resource Scan
Scan Details
Site Domain | bpwbrest.by |
Base Domain | bpwbrest.by |
Scan Status | Ok |
Last Scan | 4/3/2025, 5:36:51 AM |
Next Scan | 5/3/2025, 5:36:51 AM |
Last Scan
Scanned | 4/3/2025, 5:36:51 AM |
URL | https://bpwbrest.by/robots.txt |
Domain IPs | 141.8.194.164 |
Response IP | 141.8.194.164 |
Found | Yes |
Hash | 614afb4a38f5d7ebdcf61aab279a29bdedf1b73927ff5a6686dcc6d010ddb8a9 |
SimHash | 2907bc41df92 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /cgi-bin/ |
Disallow | /css/ |
Disallow | /js/ |
Disallow | /res/ |
Disallow | /stats/ |
Disallow | /test/ |
Disallow | /utils/ |
Disallow | /spaw2/ |
Disallow | /*?etext* |
Disallow | /*news%3A2017* |
Disallow | /*news%3A2013* |
Disallow | /*news%3A2014* |
Disallow | /*news%3A2015* |
Disallow | /*news%3A2016* |
Other Records
Field | Value |
---|---|
sitemap | https://bpwbrest.by/sitemap/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.