heyjobs.de
robots.txt

Robots Exclusion Standard data for heyjobs.de

Resource Scan

Scan Details

Site Domain heyjobs.de
Base Domain heyjobs.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-29T19:33:15+00:00
Next Scan 2024-08-27T19:33:15+00:00

Last Successful Scan

Scanned2023-01-13T12:53:43+00:00
URL https://heyjobs.de/robots.txt
Redirect https://www.heyjobs.co/robots.txt
Redirect Domain www.heyjobs.co
Redirect Base heyjobs.co
Domain IPs 13.33.88.106, 13.33.88.123, 13.33.88.43, 13.33.88.70
Redirect IPs 13.33.88.106, 13.33.88.123, 13.33.88.43, 13.33.88.70
Response IP 13.33.88.106
Found Yes
Hash f3b5e8312e97cc8ef3aedffce798493d98d20002c4fd2efbe34dea39614843c2
SimHash 8a407d87eba0

Groups

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

cesar

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

barkrowler/0.9

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

buck

Rule Path
Disallow /

*

Rule Path
Disallow */jobs/*/out
Disallow

Other Records

Field Value
sitemap https://www.heyjobs.co/sitemap.xml
sitemap https://www.heyjobs.co/gfj_sitemap.xml