jobbird.com
robots.txt
Robots Exclusion Standard data for jobbird.com
Resource Scan
Scan Details
| Site Domain | jobbird.com |
| Base Domain | jobbird.com |
| Scan Status | Ok |
| Last Scan | 2024-10-27T17:56:40+00:00 |
| Next Scan | 2024-11-26T17:56:40+00:00 |
Last Scan
| Scanned | 2024-10-27T17:56:40+00:00 |
| URL | https://jobbird.com/robots.txt |
| Redirect | https://www.jobbird.com/robots.txt |
| Redirect Domain | www.jobbird.com |
| Redirect Base | jobbird.com |
| Domain IPs | 34.247.235.234, 52.211.186.114 |
| Redirect IPs | 13.226.2.108, 13.226.2.26, 13.226.2.41, 13.226.2.64, 2600:9000:248c:0:e:aa6d:9680:93a1, 2600:9000:248c:400:e:aa6d:9680:93a1, 2600:9000:248c:4a00:e:aa6d:9680:93a1, 2600:9000:248c:ca00:e:aa6d:9680:93a1, 2600:9000:248c:ce00:e:aa6d:9680:93a1, 2600:9000:248c:e600:e:aa6d:9680:93a1, 2600:9000:248c:ee00:e:aa6d:9680:93a1, 2600:9000:248c:f400:e:aa6d:9680:93a1 |
| Response IP | 18.165.140.105 |
| Found | Yes |
| Hash | 7408778799f681958bbe11ceb3ecb49b7e80c62a313f90e9e2274f7bf0d14a35 |
| SimHash | 61455e4382d4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | *?PageSpeed=noscript |
| Disallow | *?premium=yes |
| Disallow | *%26premium%3Dyes |
| Disallow | *?jobId= |
| Disallow | /404 |
| Disallow | /de/company/* |
| Disallow | /en/company/* |
| Disallow | /ru/* |
| Disallow | /ro/* |
| Disallow | /po/* |
| Disallow | /outgoing/* |
| Disallow | /job/apply_later |
| Disallow | /job_* |
| Disallow | /*/admin$ |
| Disallow | /*/admin/* |
| Disallow | /*/api |
| Disallow | /*/export |
| Disallow | /*/xml |
| Disallow | /*/404 |
| Disallow | /*/ajax/* |
| Disallow | /*/diagnose |
| Disallow | /*/login |
| Disallow | /*/tools |
| Disallow | /*/wallboard |
| Disallow | /*/job_alert/* |
| Disallow | /*/job/apply_later |
| Disallow | /*/job_contact |
| Disallow | /*/job_mail |
| Disallow | /*/job_view_mail |
| Disallow | /*/job_view_phone |
| Disallow | /*/outgoing |
| Disallow | /de/mein/* |
| Disallow | /de/technische-wartung |
| Disallow | /de/folgen |
| Disallow | /de/stellenangebote?* |
| Disallow | /de/gespeicherte-stellenangebote |
| Disallow | /de/amp/* |
| Allow | /de/mein/lebenslauf-hochladen |
| Disallow | /nl/mijn/* |
| Disallow | /nl/technisch-onderhoud |
| Disallow | /nl/vacature-mailing/* |
| Disallow | /nl/volg |
| Disallow | /nl/vacature?* |
| Disallow | /nl/opgeslagen-vacatures |
| Disallow | /nl/amp/* |
| Allow | /nl/mijn/cv-plaatsen |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.jobbird.com/de/sitemaps/index.xml |
| sitemap | https://www.jobbird.com/nl/sitemaps/index.xml |
Comments