magdeburger-jobanzeiger.de
robots.txt
Robots Exclusion Standard data for magdeburger-jobanzeiger.de
Resource Scan
Scan Details
| Site Domain | magdeburger-jobanzeiger.de |
| Base Domain | magdeburger-jobanzeiger.de |
| Scan Status | Ok |
| Last Scan | 2024-09-23T11:51:53+00:00 |
| Next Scan | 2024-10-07T11:51:53+00:00 |
Last Scan
| Scanned | 2024-09-23T11:51:53+00:00 |
| URL | https://magdeburger-jobanzeiger.de/robots.txt |
| Redirect | https://www.magdeburger-jobanzeiger.de/robots.txt |
| Redirect Domain | www.magdeburger-jobanzeiger.de |
| Redirect Base | magdeburger-jobanzeiger.de |
| Domain IPs | 54.93.41.209 |
| Redirect IPs | 108.128.72.146, 54.216.252.255, 54.73.26.109 |
| Response IP | 54.73.26.109 |
| Found | Yes |
| Hash | f141271c2a0e901828304ee00202ec35573123582d6095b18d58454db9217fc5 |
| SimHash | 7281bf632ff4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /s/ |
| Disallow | /p/ |
| Disallow | /stellenangebote/plainx/ |
| Disallow | /tam17az1/ |
| Disallow | /job/inline/ |
| Disallow | /job/app/ |
| Disallow | /job/jobheader-full/ |
| Disallow | /job/jobheader-ref-num/ |
| Disallow | /job/plain/ |
| Disallow | /job/full/ |
| Disallow | /job/reference/ |
| Disallow | /job/bare/ |
| Disallow | /job/xing/ |
| Disallow | /jobs*offset%3D |
| Disallow | /stellenangebote*offset%3D |
| Disallow | /jobangebote*offset%3D |
| Disallow | /stellen*offset%3D |
Warnings
- `host` is not a known field.