us.jobrapido.com
robots.txt
Robots Exclusion Standard data for us.jobrapido.com
Resource Scan
Scan Details
| Site Domain | us.jobrapido.com |
| Base Domain | jobrapido.com |
| Scan Status | Ok |
| Last Scan | 2024-10-26T14:40:31+00:00 |
| Next Scan | 2024-11-25T14:40:31+00:00 |
Last Scan
| Scanned | 2024-10-26T14:40:31+00:00 |
| URL | https://us.jobrapido.com/robots.txt |
| Domain IPs | 34.111.124.179 |
| Response IP | 34.111.124.179 |
| Found | Yes |
| Hash | 6186b341afe97d57e631c60f1c4bb708ed5c09f207d55391747d7a135edd7351 |
| SimHash | 1c399bd4bbb0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*?*&o=* |
| Disallow | /*?o=* |
| Disallow | /*?*&l=* |
| Disallow | /*?l=* |
| Disallow | /*?*&q=* |
| Disallow | /*?q=* |
| Disallow | /*?*&w=* |
| Disallow | /*?w=* |
| Disallow | /*?*&r=* |
| Disallow | /*?r=* |
| Disallow | /job/* |
| Disallow | /jobpreview/* |
| Disallow | /empleo/* |
| Disallow | /trabajo/* |
| Disallow | /info/privacy-policy |
| Disallow | /images |
| Disallow | /banners |
| Disallow | /download |
| Disallow | /track |
| Disallow | /browserevent/* |
| Disallow | /*?*&sortby=* |
| Disallow | /*?sortby=* |
| Disallow | *?ft=* |
googlebot
bingbot
yandex
seznambot
| Rule | Path |
|---|---|
| Disallow | /*?*&o=* |
| Disallow | /*?o=* |
| Disallow | /*?*&l=* |
| Disallow | /*?l=* |
| Disallow | /*?*&q=* |
| Disallow | /*?q=* |
| Disallow | /*?*&w=* |
| Disallow | /*?w=* |
| Disallow | /*?*&r=* |
| Disallow | /*?r=* |
| Disallow | /job/* |
| Disallow | /empleo/* |
| Disallow | /trabajo/* |
| Disallow | /info/privacy-policy |
| Disallow | /images |
| Disallow | /banners |
| Disallow | /download |
| Disallow | /track |
| Disallow | /browserevent/* |
| Disallow | /*?*&sortby=* |
| Disallow | /*?sortby=* |
| Disallow | *?ft=* |
| Disallow | /*?*&s=* |
| Disallow | /*?s=* |
| Disallow | /sitemap/suggestedjobtitles/ |
| Disallow | /sitemap/relatedlocations/ |
| Disallow | /sitemap/topjobtitles/ |
| Disallow | /info_/ |
| Disallow | /login |
| Disallow | /signup |
| Disallow | /favouritejobs |
| Disallow | /info/contact-terms-registration |
| Disallow | /info/privacy-policy-registration |
| Disallow | /recoverpassword |
| Disallow | /blog/wp-login |
| Disallow | /blog/wp-admin |
| Disallow | /*?*&utm_agid=* |
| Disallow | /*?utm_agid=* |
| Disallow | /*?*&utm_kwid=* |
| Disallow | /*?utm_kwid=* |
| Disallow | /*?*&ft=* |
| Disallow | /*?adwords* |
| Disallow | /%3Fq%3D |
| Disallow | /*?j=* |
| Disallow | /media/ |