careerist.com
robots.txt
Robots Exclusion Standard data for careerist.com
Resource Scan
Scan Details
| Site Domain | careerist.com |
| Base Domain | careerist.com |
| Scan Status | Ok |
| Last Scan | 2024-05-31T17:23:59+00:00 |
| Next Scan | 2024-06-30T17:23:59+00:00 |
Last Scan
| Scanned | 2024-05-31T17:23:59+00:00 |
| URL | https://careerist.com/robots.txt |
| Redirect | https://www.careerist.com/robots.txt |
| Redirect Domain | www.careerist.com |
| Redirect Base | careerist.com |
| Domain IPs | 20.218.159.20 |
| Redirect IPs | 162.159.140.98, 172.66.0.96, 2606:4700:7::60, 2a06:98c1:58::60 |
| Response IP | 172.66.0.96 |
| Found | Yes |
| Hash | 4a0b66302728a84563bc0e924c3c1d2733b1869697247ce36f18e4ac6f1f63ed |
| SimHash | 4a292d636d10 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /*.css |
| Allow | /*.png |
| Allow | /*.jpeg |
| Allow | /*.jpg |
| Allow | /*.js |
| Disallow | /tdraft |
| Disallow | /fin |
| Disallow | /drafts |
| Disallow | /o/ |
| Disallow | /jobeasy/ |
| Disallow | /old/ |
| Disallow | /old/* |
| Disallow | *-copy |
| Disallow | *-test$ |
| Disallow | /old-home |
| Disallow | /lp1-form |
| Disallow | /success-careerupse |
| Disallow | /success-careerupse-final |
| Disallow | /success-nonq-careerupse-final |
| Disallow | /copy/3-1-qa |
| Disallow | /3-1-qa-old |
| Disallow | /form-cv-ru |
| Disallow | /form-cv |
| Disallow | /qa-new-design |
| Disallow | /python-intensive-snake |
| Disallow | /us-job-careerist |
| Disallow | /search |
| Disallow | /steps-finish-non-qualificated |
| Disallow | /success-careerup |
| Disallow | /success-nonq-careerup-final |
| Disallow | /success-careerup-final |
| Disallow | /ru/usajob-careerist |
| Disallow | /webinar-special |
| Disallow | /es-insights-test |
| Disallow | /es-insights-test/* |
| Disallow | *_page%3D1$ |
| Disallow | /system-test |
Other Records
| Field | Value |
|---|---|
| sitemap | https://careerist.com/sitemap.xml |