motopoland.com.ua
robots.txt
Robots Exclusion Standard data for motopoland.com.ua
Resource Scan
Scan Details
Site Domain | motopoland.com.ua |
Base Domain | motopoland.com.ua |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-08-20T13:12:06+00:00 |
Next Scan | 2024-10-19T13:12:06+00:00 |
Last Successful Scan
Scanned | 2024-05-30T13:10:51+00:00 |
URL | https://motopoland.com.ua/robots.txt |
Domain IPs | 104.21.37.210, 172.67.213.116, 2606:4700:3030::ac43:d574, 2606:4700:3034::6815:25d2 |
Response IP | 104.21.37.210 |
Found | Yes |
Hash | 9a04404044c1372adbe3f5eea448709ec9ee836364e0bc282583231dd42e051c |
SimHash | 7056234aecb2 |
Groups
*
Rule | Path |
---|---|
Disallow | /viewed/ |
Disallow | /favorites/ |
Other Records
Field | Value |
---|---|
sitemap | https://motopoland.com.ua/sitemap/extra-products/all-extra-product.xml |
sitemap | https://motopoland.com.ua/sitemap/auto_index.xml |
sitemap | https://motopoland.com.ua/sitemap/sitemaps_all.xml |
Warnings
- 24 invalid lines.