srovnanicen.cz
robots.txt
Robots Exclusion Standard data for srovnanicen.cz
Resource Scan
Scan Details
Site Domain | srovnanicen.cz |
Base Domain | srovnanicen.cz |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-11-13T04:08:20+00:00 |
Next Scan | 2024-11-27T04:08:20+00:00 |
Last Successful Scan
Scanned | 2024-10-29T03:22:25+00:00 |
URL | https://srovnanicen.cz/robots.txt |
Redirect | https://www.srovnanicen.cz/robots.txt |
Redirect Domain | www.srovnanicen.cz |
Redirect Base | srovnanicen.cz |
Domain IPs | 185.68.70.167 |
Redirect IPs | 185.68.70.167 |
Response IP | 185.68.70.167 |
Found | Yes |
Hash | 60e710065a68195e6851051fe11389e413210432ad690c5e843e88e21994ba7e |
SimHash | ea47d602d4b5 |
Groups
*
Rule | Path |
---|---|
Disallow | /*utm_ |
Disallow | /exit/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.srovnanicen.cz/sitemap.xml |
Warnings
- `request-rate` is not a known field.
- `robot-version` is not a known field.