butysportowe.pl
robots.txt
Robots Exclusion Standard data for butysportowe.pl
Resource Scan
Scan Details
| Site Domain | butysportowe.pl |
| Base Domain | butysportowe.pl |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-03-07T07:30:11+00:00 |
| Next Scan | 2024-06-05T07:30:11+00:00 |
Last Successful Scan
| Scanned | 2023-10-17T07:28:36+00:00 |
| URL | https://butysportowe.pl/robots.txt |
| Domain IPs | 23.215.7.14, 23.215.7.21 |
| Response IP | 23.59.168.152 |
| Found | Yes |
| Hash | 760f233080453b2c872be88ed48141f9e3e01a73c3dac7c250a05dff63cea7b7 |
| SimHash | e197714a8f66 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search* |
| Disallow | /ad/* |
| Disallow | /profile |
| Disallow | /*recommendation.json* |
| Disallow | /product/* |
| Disallow | /pdf/* |
| Disallow | /order/* |
| Disallow | /payment/* |
| Disallow | /_ajax/execute |
| Disallow | /ad/* |
| Disallow | /ajax/cart/mini/display |
| Disallow | /product/add-to-save-box/* |
| Disallow | /koszyk/ |
| Disallow | /login |
| Disallow | /search |
| Disallow | /registration |
| Disallow | /resetting |
Other Records
| Field | Value |
|---|---|
| sitemap | https://butysportowe.pl/sitemap/sitemap.xml |
Comments