metal-firms.in.ua
robots.txt
Robots Exclusion Standard data for metal-firms.in.ua
Resource Scan
Scan Details
Site Domain | metal-firms.in.ua |
Base Domain | metal-firms.in.ua |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2025-03-27T21:50:00+00:00 |
Next Scan | 2025-06-25T21:50:00+00:00 |
Last Successful Scan
Scanned | 2023-12-04T21:23:05+00:00 |
URL | https://metal-firms.in.ua/robots.txt |
Domain IPs | 104.21.7.26, 172.67.135.168, 2606:4700:3032::6815:71a, 2606:4700:3033::ac43:87a8 |
Response IP | 172.67.135.168 |
Found | Yes |
Hash | ecdb8811ba1a9065cde2df53ee676272eb0be4a46d8271417123e6d4445eacaa |
SimHash | 7824df6b03e4 |
Groups
*
Rule | Path |
---|---|
Disallow | /cp/ |
Disallow | /banner/ |
Disallow | /banner2/ |
Disallow | /gallery/ |
Disallow | /fonts/ |
Disallow | /lang/ |
Disallow | /logo/ |
Disallow | /offer/ |
Disallow | /upload/ |
Disallow | /template/ |
Disallow | /conf/ |
Allow | /template/default/*.gif* |
Allow | /template/default/*.jpg* |
Allow | /template/default/*.png* |
Allow | /template/default/*.css* |
Allow | /banner2/*.gif* |
Allow | /banner2/*.jpg* |
Allow | /banner2/*.bmp* |
Allow | /default/*.gif* |
Allow | /wr_board/images/gray/*.gif* |
Other Records
Field | Value |
---|---|
sitemap | https://metal-firms.in.ua/sitemap.xml |
Warnings
- `host` is not a known field.