jobteaser.com
robots.txt
Robots Exclusion Standard data for jobteaser.com
Resource Scan
Scan Details
| Site Domain | jobteaser.com |
| Base Domain | jobteaser.com |
| Scan Status | Ok |
| Last Scan | 2024-09-21T21:17:00+00:00 |
| Next Scan | 2024-10-05T21:17:00+00:00 |
Last Scan
| Scanned | 2024-09-21T21:17:00+00:00 |
| URL | https://jobteaser.com/robots.txt |
| Redirect | https://www.jobteaser.com/robots.txt |
| Redirect Domain | www.jobteaser.com |
| Redirect Base | jobteaser.com |
| Domain IPs | 104.18.30.61, 104.18.31.61 |
| Redirect IPs | 104.18.22.75, 104.18.23.75, 2606:4700::6812:164b, 2606:4700::6812:174b |
| Response IP | 104.18.22.75 |
| Found | Yes |
| Hash | b1f579ad82931788c7fe321573d901b3c871fc89350ade07d5f4296142ae71d6 |
| SimHash | e114a0238bf1 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /ca/home |
| Disallow | /ca |
| Allow | /cs/home |
| Disallow | /cs |
| Allow | /fi/home |
| Disallow | /fi |
| Allow | /gl/home |
| Disallow | /gl |
| Allow | /it/home |
| Disallow | /it |
| Allow | /no/home |
| Disallow | /no |
| Allow | /pl/home |
| Disallow | /pl |
| Allow | /pt/home |
| Disallow | /pt |
| Allow | /sv/home |
| Disallow | /sv |
| Allow | /*/job-search/* |
| Disallow | /cdn-cgi/ |
| Disallow | */apply_to_extern_url |
| Disallow | /*?* |
| Disallow | /system |
| Disallow | /*/companies/job-offers/*?locale=* |
| Disallow | /*/job-offers?locale=*&page=*&* |
| Allow | /*?page=* |
| Allow | /*/job-offers?locale=* |
| Disallow | /*?page=*&* |
| Allow | /*?p=* |
| Disallow | /*?p=*&* |
| Allow | /*utm_* |
| Allow | /*advices*from_overview* |
| Allow | /*advices*from_search* |
| Allow | /*advices*parent_topic* |
| Disallow | /*advice_search/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://assets-cf.jobteaser.com/sitemaps/sitemap.xml |