coface.de
robots.txt
Robots Exclusion Standard data for coface.de
Resource Scan
Scan Details
Site Domain | coface.de |
Base Domain | coface.de |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-16T18:28:10+00:00 |
Next Scan | 2024-11-15T18:28:10+00:00 |
Last Successful Scan
Scanned | 2024-06-26T18:25:55+00:00 |
URL | https://coface.de/robots.txt |
Redirect | https://www.coface.de/robots.txt |
Redirect Domain | www.coface.de |
Redirect Base | coface.de |
Domain IPs | 13.225.4.22, 13.225.4.36, 13.225.4.53, 13.225.4.74 |
Redirect IPs | 13.225.4.22, 13.225.4.36, 13.225.4.53, 13.225.4.74 |
Response IP | 13.225.4.36 |
Found | Yes |
Hash | b231f17e2fa3e655c7857db903a920c3380b789bc30ef6ade9c2ddd5575217b0 |
SimHash | 0840d5975b13 |
Groups
*
Rule | Path |
---|---|
Allow | /*.js |
Allow | /*.css |
Allow | /*.jpg |
Allow | /*.jpeg |
Allow | /*.png |
Allow | /*.svg |
Disallow | */search-result?query=* |
Disallow | */links/* |
Disallow | */home-page-blocks/* |
Disallow | */footer/* |
Disallow | */pop-in-log-in/* |
Disallow | */Media/* |
Disallow | */forms/* |
Disallow | */var/cofaweb/* |
Disallow | */1000 |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://www.coface.de/sitemap_index.xml |
Warnings
- `crawl delay` is not a known field.