bebek.clothing
robots.txt
Robots Exclusion Standard data for bebek.clothing
Resource Scan
Scan Details
| Site Domain | bebek.clothing |
| Base Domain | bebek.clothing |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-05-25T00:06:38+00:00 |
| Next Scan | 2024-07-24T00:06:38+00:00 |
Last Successful Scan
| Scanned | 2024-03-03T23:41:34+00:00 |
| URL | https://bebek.clothing/robots.txt |
| Domain IPs | 104.26.4.86, 104.26.5.86, 172.67.71.178, 2606:4700:20::681a:456, 2606:4700:20::681a:556, 2606:4700:20::ac43:47b2 |
| Response IP | 104.26.4.86 |
| Found | Yes |
| Hash | bbf995f043f5f316754447f777352131e71caf5c345d350ebf7bad78f69d77cc |
| SimHash | 5f055b449716 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*?age= |
| Disallow | /*%26color%3D |
| Disallow | /*%26brand%3D |
| Disallow | /*?sort_by= |
| Disallow | /*login |
| Disallow | /*logout |
| Disallow | /*?page= |
| Disallow | /*search%3D |
| Disallow | /*cart/ |
| Disallow | /*?pr= |
| Disallow | /*auth/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://bebek.clothing/sitemap.xml |
Warnings
- `clean-param` is not a known field.