clickworker.fr
robots.txt
Robots Exclusion Standard data for clickworker.fr
Resource Scan
Scan Details
| Site Domain | clickworker.fr |
| Base Domain | clickworker.fr |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-28T04:33:41+00:00 |
| Next Scan | 2024-11-27T04:33:41+00:00 |
Last Successful Scan
| Scanned | 2024-07-24T02:43:44+00:00 |
| URL | https://clickworker.fr/robots.txt |
| Domain IPs | 104.21.10.108, 172.67.131.115, 2606:4700:3033::6815:a6c, 2606:4700:3033::ac43:8373 |
| Response IP | 172.67.131.115 |
| Found | Yes |
| Hash | fdeebe783044040fdf85c3fae052acba3c11282e0ef68ca8581b5d5e0e88c29d |
| SimHash | ca85d8320933 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /wp-admin/admin-ajax.php |
| Disallow | /apple-app-site-association |
| Disallow | /.well-known |
| Disallow | /product-wizard |
| Disallow | /tagesdateien01 |
| Disallow | /wp-content/cache/ |
| Disallow | /community_advent_calendar/ |
*
| Rule | Path |
|---|---|
| Disallow |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.clickworker.de/sitemap_index.xml/ |