job-norden.de
robots.txt
Robots Exclusion Standard data for job-norden.de
Resource Scan
Scan Details
Site Domain | job-norden.de |
Base Domain | job-norden.de |
Scan Status | Ok |
Last Scan | 2024-09-23T23:22:18+00:00 |
Next Scan | 2024-09-30T23:22:18+00:00 |
Last Scan
Scanned | 2024-09-23T23:22:18+00:00 |
URL | https://job-norden.de/robots.txt |
Redirect | https://www.job-norden.de/robots.txt |
Redirect Domain | www.job-norden.de |
Redirect Base | job-norden.de |
Domain IPs | 108.128.0.196, 18.203.212.239 |
Redirect IPs | 13.226.2.102, 13.226.2.104, 13.226.2.12, 13.226.2.69 |
Response IP | 13.226.2.104 |
Found | Yes |
Hash | 5c3e87a031bc75aa59d9fd135a2fdc8b6588a5c8574827a6448806f46da39ebe |
SimHash | cc2459448d31 |
Groups
*
Rule | Path |
---|---|
Allow | /administration |
Disallow | /admin |
Disallow | /jobPosting/feed |
Disallow | /jobPosting/feed? |
Disallow | /features |
Disallow | /features? |
Other Records
Field | Value |
---|---|
sitemap | https://www.job-norden.de/sitemap |