jobteaser.com
robots.txt
Robots Exclusion Standard data for jobteaser.com
Resource Scan
Scan Details
| Site Domain | jobteaser.com |
| Base Domain | jobteaser.com |
| Scan Status | Ok |
| Last Scan | 2024-11-03T02:57:37+00:00 |
| Next Scan | 2024-11-17T02:57:37+00:00 |
Last Scan
| Scanned | 2024-11-03T02:57:37+00:00 |
| URL | https://jobteaser.com/robots.txt |
| Redirect | https://www.jobteaser.com/robots.txt |
| Redirect Domain | www.jobteaser.com |
| Redirect Base | jobteaser.com |
| Domain IPs | 104.18.30.61, 104.18.31.61 |
| Redirect IPs | 104.18.22.75, 104.18.23.75, 2606:4700::6812:164b, 2606:4700::6812:174b |
| Response IP | 104.18.22.75 |
| Found | Yes |
| Hash | 7934d288b6d16362d9d6906fce893e5cf0ba85b06db5a4968e214a9db71d0143 |
| SimHash | cb3ca6058f92 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /ca$ |
| Disallow | /ca/ |
| Allow | /cs$ |
| Disallow | /cs/ |
| Allow | /fi$ |
| Disallow | /fi/ |
| Allow | /gl$ |
| Disallow | /gl/ |
| Allow | /it$ |
| Disallow | /it/ |
| Allow | /no$ |
| Disallow | /no/ |
| Allow | /pl$ |
| Disallow | /pl/ |
| Allow | /pt$ |
| Disallow | /pt/ |
| Allow | /sv$ |
| Disallow | /sv/ |
| Allow | /*/job-search/* |
| Disallow | /cdn-cgi/ |
| Disallow | */apply_to_extern_url |
| Disallow | /*?* |
| Disallow | /system |
| Disallow | /*/companies/job-offers/*?locale=* |
| Disallow | /*/job-offers?locale=*&page=*&* |
| Allow | /*?page=* |
| Allow | /*/job-offers?locale=* |
| Disallow | /*?page=*&* |
| Allow | /*?p=* |
| Disallow | /*?p=*&* |
| Allow | /*utm_* |
| Allow | /*advices*from_overview* |
| Allow | /*advices*from_search* |
| Allow | /*advices*parent_topic* |
| Disallow | /*advice_search/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://static-assets.jobteasercdn.com/sitemaps/sitemap.xml |