taskrabbit.de
robots.txt

Robots Exclusion Standard data for taskrabbit.de

Resource Scan

Scan Details

Site Domain taskrabbit.de
Base Domain taskrabbit.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-07-05T18:19:11+00:00
Next Scan 2025-10-03T18:19:11+00:00

Last Successful Scan

Scanned2023-09-04T12:32:59+00:00
URL https://taskrabbit.de/robots.txt
Redirect https://www.taskrabbit.de/robots.txt
Redirect Domain www.taskrabbit.de
Redirect Base taskrabbit.de
Domain IPs 54.153.4.39, 54.176.73.171
Redirect IPs 54.153.4.39, 54.176.73.171
Response IP 54.153.4.39
Found Yes
Hash 7a6d5a8a3600c1c6c1f1391196d6913a3bf74dce242419ad1757df850e159619
SimHash 8908dc0489b3

Groups

*

Rule Path
Disallow /admin
Disallow /tasks/r/form

Other Records

Field Value
sitemap https://www.taskrabbit.de/sitemap.xml.gz