bau.career
robots.txt
Robots Exclusion Standard data for bau.career
Resource Scan
Scan Details
| Site Domain | bau.career |
| Base Domain | bau.career |
| Scan Status | Ok |
| Last Scan | 2024-09-22T06:02:25+00:00 |
| Next Scan | 2024-10-06T06:02:25+00:00 |
Last Scan
| Scanned | 2024-09-22T06:02:25+00:00 |
| URL | https://bau.career/robots.txt |
| Redirect | https://www.bau.career/robots.txt |
| Redirect Domain | www.bau.career |
| Redirect Base | bau.career |
| Domain IPs | 54.93.41.209 |
| Redirect IPs | 108.128.72.146, 54.216.252.255, 54.73.26.109 |
| Response IP | 54.216.252.255 |
| Found | Yes |
| Hash | ef3399d59ad47206c7bd509ded71760308340982b98d2c42af97310c04d0c55a |
| SimHash | 6281bf63afd4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /s/ |
| Disallow | /p/ |
| Disallow | /stellenangebote/plainx/ |
| Disallow | /tam17az1/ |
| Disallow | /job/inline/ |
| Disallow | /job/app/ |
| Disallow | /job/jobheader-full/ |
| Disallow | /job/jobheader-ref-num/ |
| Disallow | /job/plain/ |
| Disallow | /job/full/ |
| Disallow | /job/reference/ |
| Disallow | /job/bare/ |
| Disallow | /job/xing/ |
| Disallow | /jobs*offset%3D |
| Disallow | /stellenangebote*offset%3D |
| Disallow | /jobangebote*offset%3D |
| Disallow | /stellen*offset%3D |
Other Records
| Field | Value |
|---|---|
| sitemap | https://yourfirm-prod-data.s3.amazonaws.com/sitemaps/www.bau.career/sitemap.xml |
Warnings
- `host` is not a known field.