taskrabbit.pt
robots.txt
Robots Exclusion Standard data for taskrabbit.pt
Resource Scan
Scan Details
| Site Domain | taskrabbit.pt |
| Base Domain | taskrabbit.pt |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-07-05T18:20:11+00:00 |
| Next Scan | 2025-10-03T18:20:11+00:00 |
Last Successful Scan
| Scanned | 2023-09-04T12:32:59+00:00 |
| URL | https://taskrabbit.pt/robots.txt |
| Redirect | https://www.taskrabbit.pt/robots.txt |
| Redirect Domain | www.taskrabbit.pt |
| Redirect Base | taskrabbit.pt |
| Domain IPs | 54.153.4.39, 54.176.73.171 |
| Redirect IPs | 54.153.4.39, 54.176.73.171 |
| Response IP | 54.176.73.171 |
| Found | Yes |
| Hash | f5687868bf37a2d24cd542ce64a2db36c7e53eab6de25e7e5f47372e844bc338 |
| SimHash | cd01dc00add3 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.taskrabbit.pt/sitemap.xml.gz |