work5.de
robots.txt

Robots Exclusion Standard data for work5.de

Resource Scan

Scan Details

Site Domain work5.de
Base Domain work5.de
Scan Status Ok
Last Scan2025-12-17T09:12:40+00:00
Next Scan 2025-12-24T09:12:40+00:00

Last Scan

Scanned2025-12-17T09:12:40+00:00
URL https://work5.de/robots.txt
Domain IPs 104.21.0.213, 172.67.128.77, 2606:4700:3032::ac43:804d, 2606:4700:3033::6815:d5
Response IP 172.67.128.77
Found Yes
Hash cd00ad25e1413f04c25d65a3524111824a4453c6418c9a0a119f15a6d3545f6e
SimHash 49094e268535

Groups

*

Rule Path
Disallow /admin/
Disallow /login/
Disallow /registration/
Disallow /journey/
Disallow /api/
Disallow /dienstleister/*/nachrichten/
Disallow /businesses/*/messages/
Disallow /capacity-request/
Disallow /myfive/
Disallow /search$
Disallow /*?city=nicht*
Disallow /*?city=not*
Disallow /*/nicht-gefunden
Disallow /*/not-found

Other Records

Field Value
sitemap https://work5.de/sitemap.xml
sitemap https://work5.de/sitemap_blog.xml
sitemap https://work5.de/sitemap_business_categories.xml
sitemap https://work5.de/sitemap_businesses.xml
sitemap https://work5.de/sitemap_guides.xml
sitemap https://work5.de/sitemap_job_categories.xml
sitemap https://work5.de/sitemap_jobs.xml
sitemap https://work5.de/sitemap_semrush.xml
sitemap https://work5.de/sitemap_sites.xml