aachener-jobanzeiger.de
robots.txt
Robots Exclusion Standard data for aachener-jobanzeiger.de
Resource Scan
Scan Details
Site Domain | aachener-jobanzeiger.de |
Base Domain | aachener-jobanzeiger.de |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-09-08T03:03:29+00:00 |
Next Scan | 2025-12-07T03:03:29+00:00 |
Last Successful Scan
Scanned | 2025-05-04T20:22:47+00:00 |
URL | https://aachener-jobanzeiger.de/robots.txt |
Redirect | https://www.aachener-jobanzeiger.de/robots.txt |
Redirect Domain | www.aachener-jobanzeiger.de |
Redirect Base | aachener-jobanzeiger.de |
Domain IPs | 2600:9000:2795:600:19:f748:1640:93a1, 2600:9000:2795:7400:19:f748:1640:93a1, 2600:9000:2795:8000:19:f748:1640:93a1, 2600:9000:2795:a000:19:f748:1640:93a1, 2600:9000:2795:ae00:19:f748:1640:93a1, 2600:9000:2795:b000:19:f748:1640:93a1, 2600:9000:2795:d200:19:f748:1640:93a1, 2600:9000:2795:d400:19:f748:1640:93a1, 3.169.71.104, 3.169.71.11, 3.169.71.15, 3.169.71.78 |
Redirect IPs | 104.26.4.220, 104.26.5.220, 172.67.74.217, 2606:4700:20::681a:4dc, 2606:4700:20::681a:5dc, 2606:4700:20::ac43:4ad9 |
Response IP | 172.67.74.217 |
Found | Yes |
Hash | e9e62dc61fbdeb4fd299c9d7fa02151dcb79492cc7510746808dd3c7c5c4c92a |
SimHash | 7281bf632ff4 |
Groups
*
Rule | Path |
---|---|
Disallow | /s/ |
Disallow | /p/ |
Disallow | /stellenangebote/plainx/ |
Disallow | /tam17az1/ |
Disallow | /job/inline/ |
Disallow | /job/app/ |
Disallow | /job/jobheader-full/ |
Disallow | /job/jobheader-ref-num/ |
Disallow | /job/plain/ |
Disallow | /job/full/ |
Disallow | /job/reference/ |
Disallow | /job/bare/ |
Disallow | /job/xing/ |
Disallow | /jobs*offset%3D |
Disallow | /stellenangebote*offset%3D |
Disallow | /jobangebote*offset%3D |
Disallow | /stellen*offset%3D |
Warnings
- `host` is not a known field.