berliner-jobanzeiger.de
robots.txt
Robots Exclusion Standard data for berliner-jobanzeiger.de
Resource Scan
Scan Details
| Site Domain | berliner-jobanzeiger.de |
| Base Domain | berliner-jobanzeiger.de |
| Scan Status | Ok |
| Last Scan | 2024-06-17T20:07:47+00:00 |
| Next Scan | 2024-07-01T20:07:47+00:00 |
Last Scan
| Scanned | 2024-06-17T20:07:47+00:00 |
| URL | https://berliner-jobanzeiger.de/robots.txt |
| Redirect | https://www.berliner-jobanzeiger.de/robots.txt |
| Redirect Domain | www.berliner-jobanzeiger.de |
| Redirect Base | berliner-jobanzeiger.de |
| Domain IPs | 54.93.41.209 |
| Redirect IPs | 108.128.72.146, 54.216.252.255, 54.73.26.109 |
| Response IP | 108.128.72.146 |
| Found | Yes |
| Hash | b33d58df632ec2cb51a50c7b5fa76052e5182c637c7e0f7f21fc1524d5a2dc30 |
| SimHash | 7081ff632ff4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /s/ |
| Disallow | /p/ |
| Disallow | /stellenangebote/plainx/ |
| Disallow | /tam17az1/ |
| Disallow | /job/inline/ |
| Disallow | /job/app/ |
| Disallow | /job/jobheader-full/ |
| Disallow | /job/jobheader-ref-num/ |
| Disallow | /job/plain/ |
| Disallow | /job/full/ |
| Disallow | /job/reference/ |
| Disallow | /job/bare/ |
| Disallow | /job/xing/ |
| Disallow | /jobs*offset%3D |
| Disallow | /stellenangebote*offset%3D |
| Disallow | /jobangebote*offset%3D |
| Disallow | /stellen*offset%3D |
Warnings
- `host` is not a known field.