cv-library.net
robots.txt
Robots Exclusion Standard data for cv-library.net
Resource Scan
Scan Details
| Site Domain | cv-library.net |
| Base Domain | cv-library.net |
| Scan Status | Ok |
| Last Scan | 2026-03-04T21:07:39+00:00 |
| Next Scan | 2026-03-11T21:07:39+00:00 |
Last Scan
| Scanned | 2026-03-04T21:07:39+00:00 |
| URL | https://cv-library.net/robots.txt |
| Redirect | https://www.cv-library.co.uk/robots.txt |
| Redirect Domain | www.cv-library.co.uk |
| Redirect Base | cv-library.co.uk |
| Domain IPs | 13.134.83.109, 18.132.241.251, 3.10.110.51 |
| Redirect IPs | 104.18.22.207, 104.18.23.207 |
| Response IP | 104.18.23.207 |
| Found | Yes |
| Hash | 76a7f1546f0900a6b99d8ef0b536b0e3324914273f767ea7658f7348e82e0507 |
| SimHash | 8709ddc1045a |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Allow | / | added 30.09.2019 |
| Disallow | /*?order* | added 02.06.2020 |
| Disallow | /*%26order* | added 02.06.2020 |
| Disallow | /*?salary* | added 02.06.2020 |
| Disallow | /*%26salary* | added 02.06.2020 |
| Disallow | /*?perpage* | added 02.06.2020 |
| Disallow | /*%26perpage* | added 02.06.2020 |
| Disallow | /*advertise-jobs? | added 22.10.2019 |
| Disallow | /aff/* | - |
| Disallow | /apply/ | added 18.12.2019 |
| Disallow | /*?ar= | added 22.10.2019 |
| Disallow | /candidate/ | - |
| Disallow | /cgi-bin/ | updated 30.09.2019 |
| Disallow | /candidate/savejob* | - |
| Disallow | /codetrial/ | - |
| Disallow | /*cvdb7n%3D | added 22.10.2019 |
| Disallow | /*cvdb14n%3D | added 18.12.2019 |
| Disallow | /*?distance=* | added 18.12.2019 |
| Disallow | /*?posted=* | added 04.06.2020 |
| Disallow | /*%26posted%3D* | added 04.06.2020 |
| Disallow | /employer_trial/ | - |
| Disallow | /entercode/ | - |
| Disallow | /external/ | added 18.12.2019 |
| Disallow | /*featured%3D* | added 30.09.2019 |
| Allow | /job/ | added 30.09.2019 |
| Disallow | /job/*/*/apply | - |
| Disallow | /job/*/*/apply/external | - |
| Disallow | /job/*/*/email | - |
| Allow | /jobs/ | added 30.09.2019 |
| Disallow | /jobs/*?id=* | added 30.09.2019 |
| Disallow | /*/key/ | added 04/11/2019 |
| Disallow | /login/ | - |
| Disallow | /*?hl= | added 18.12.2019 |
| Disallow | /r/ | - |
| Disallow | /recruiter-profile/ | added 22.10.2019 |
| Disallow | /refer/ | added 22.10.2019 |
| Disallow | /register?* | added 22.10.2019 |
| Disallow | /register?id=* | added 09.10.2019 |
| Disallow | /register/*?id=* | added 09.10.2019 |
| Disallow | /refer/ | added 09.10.2019 |
| Disallow | /recruiter/ | - |
| Disallow | /trial/ | - |
| Disallow | /trial-code/ | - |
| Disallow | /trialcode/ | - |
| Disallow | /*?ts= | added 22.10.2019 |
| Disallow | /*/*/page/*/ | added 04/11/2019 |
| Disallow | /*%26page%3D* | added 18.12.2019 |
| Disallow | /press/* | - |
| Disallow | /*preview_id%3D | added 22.10.2019 |
| Disallow | /search/ | added 25.11.2019 |
| Disallow | /*search-cvs? | added 22.10.2019 |
| Disallow | /*search?q= | added 22.10.2019 |
| Disallow | /*sid%3D | added 30.09.2019 |
| Disallow | /*?sj= | added 22.10.2019 |
| Disallow | /*?Subject= | added 18.12.2019 |
| Disallow | */?utm_source=* | added 09.10.2019 / Updated 18.12.2019 |
| Disallow | /welcome-back?id=* | added 09.10.2019 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.cv-library.co.uk/sitemaps/browse-jobs-index.xml |
| sitemap | https://www.cv-library.co.uk/sitemaps/jobs-industry-by-location-index.xml |
| sitemap | https://www.cv-library.co.uk/sitemaps/jobs-industry-index.xml |
| sitemap | https://www.cv-library.co.uk/sitemaps/jobs-location-index.xml |
| sitemap | https://www.cv-library.co.uk/sitemaps/jobs-parent-index.xml |
| sitemap | https://www.cv-library.co.uk/sitemaps/job-posts-index.xml |
| sitemap | https://www.cv-library.co.uk/sitemaps/recruiters-index.xml |
| sitemap | https://www.cv-library.co.uk/sitemaps/salary-guide-index.xml |
Comments