ca.jobrapido.com
robots.txt
Robots Exclusion Standard data for ca.jobrapido.com
Resource Scan
Scan Details
Site Domain | ca.jobrapido.com |
Base Domain | jobrapido.com |
Scan Status | Ok |
Last Scan | 2024-10-21T10:36:46+00:00 |
Next Scan | 2024-11-20T10:36:46+00:00 |
Last Scan
Scanned | 2024-10-21T10:36:46+00:00 |
URL | https://ca.jobrapido.com/robots.txt |
Domain IPs | 34.111.124.179 |
Response IP | 34.111.124.179 |
Found | Yes |
Hash | 6186b341afe97d57e631c60f1c4bb708ed5c09f207d55391747d7a135edd7351 |
SimHash | 1c399bd4bbb0 |
Groups
*
Rule | Path |
---|---|
Disallow | /*?*&o=* |
Disallow | /*?o=* |
Disallow | /*?*&l=* |
Disallow | /*?l=* |
Disallow | /*?*&q=* |
Disallow | /*?q=* |
Disallow | /*?*&w=* |
Disallow | /*?w=* |
Disallow | /*?*&r=* |
Disallow | /*?r=* |
Disallow | /job/* |
Disallow | /jobpreview/* |
Disallow | /empleo/* |
Disallow | /trabajo/* |
Disallow | /info/privacy-policy |
Disallow | /images |
Disallow | /banners |
Disallow | /download |
Disallow | /track |
Disallow | /browserevent/* |
Disallow | /*?*&sortby=* |
Disallow | /*?sortby=* |
Disallow | *?ft=* |
googlebot
bingbot
yandex
seznambot
Rule | Path |
---|---|
Disallow | /*?*&o=* |
Disallow | /*?o=* |
Disallow | /*?*&l=* |
Disallow | /*?l=* |
Disallow | /*?*&q=* |
Disallow | /*?q=* |
Disallow | /*?*&w=* |
Disallow | /*?w=* |
Disallow | /*?*&r=* |
Disallow | /*?r=* |
Disallow | /job/* |
Disallow | /empleo/* |
Disallow | /trabajo/* |
Disallow | /info/privacy-policy |
Disallow | /images |
Disallow | /banners |
Disallow | /download |
Disallow | /track |
Disallow | /browserevent/* |
Disallow | /*?*&sortby=* |
Disallow | /*?sortby=* |
Disallow | *?ft=* |
Disallow | /*?*&s=* |
Disallow | /*?s=* |
Disallow | /sitemap/suggestedjobtitles/ |
Disallow | /sitemap/relatedlocations/ |
Disallow | /sitemap/topjobtitles/ |
Disallow | /info_/ |
Disallow | /login |
Disallow | /signup |
Disallow | /favouritejobs |
Disallow | /info/contact-terms-registration |
Disallow | /info/privacy-policy-registration |
Disallow | /recoverpassword |
Disallow | /blog/wp-login |
Disallow | /blog/wp-admin |
Disallow | /*?*&utm_agid=* |
Disallow | /*?utm_agid=* |
Disallow | /*?*&utm_kwid=* |
Disallow | /*?utm_kwid=* |
Disallow | /*?*&ft=* |
Disallow | /*?adwords* |
Disallow | /%3Fq%3D |
Disallow | /*?j=* |
Disallow | /media/ |