aachener-jobanzeiger.de
robots.txt

Robots Exclusion Standard data for aachener-jobanzeiger.de

Resource Scan

Scan Details

Site Domain aachener-jobanzeiger.de
Base Domain aachener-jobanzeiger.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-08T03:03:29+00:00
Next Scan 2025-12-07T03:03:29+00:00

Last Successful Scan

Scanned2025-05-04T20:22:47+00:00
URL https://aachener-jobanzeiger.de/robots.txt
Redirect https://www.aachener-jobanzeiger.de/robots.txt
Redirect Domain www.aachener-jobanzeiger.de
Redirect Base aachener-jobanzeiger.de
Domain IPs 2600:9000:2795:600:19:f748:1640:93a1, 2600:9000:2795:7400:19:f748:1640:93a1, 2600:9000:2795:8000:19:f748:1640:93a1, 2600:9000:2795:a000:19:f748:1640:93a1, 2600:9000:2795:ae00:19:f748:1640:93a1, 2600:9000:2795:b000:19:f748:1640:93a1, 2600:9000:2795:d200:19:f748:1640:93a1, 2600:9000:2795:d400:19:f748:1640:93a1, 3.169.71.104, 3.169.71.11, 3.169.71.15, 3.169.71.78
Redirect IPs 104.26.4.220, 104.26.5.220, 172.67.74.217, 2606:4700:20::681a:4dc, 2606:4700:20::681a:5dc, 2606:4700:20::ac43:4ad9
Response IP 172.67.74.217
Found Yes
Hash e9e62dc61fbdeb4fd299c9d7fa02151dcb79492cc7510746808dd3c7c5c4c92a
SimHash 7281bf632ff4

Groups

*

Rule Path
Disallow /s/
Disallow /p/
Disallow /stellenangebote/plainx/
Disallow /tam17az1/
Disallow /job/inline/
Disallow /job/app/
Disallow /job/jobheader-full/
Disallow /job/jobheader-ref-num/
Disallow /job/plain/
Disallow /job/full/
Disallow /job/reference/
Disallow /job/bare/
Disallow /job/xing/
Disallow /jobs*offset%3D
Disallow /stellenangebote*offset%3D
Disallow /jobangebote*offset%3D
Disallow /stellen*offset%3D

Warnings

  • `host` is not a known field.