jobatus.es
robots.txt
Robots Exclusion Standard data for jobatus.es
Resource Scan
Scan Details
| Site Domain | jobatus.es |
| Base Domain | jobatus.es |
| Scan Status | Ok |
| Last Scan | 2024-09-21T06:29:00+00:00 |
| Next Scan | 2024-09-28T06:29:00+00:00 |
Last Scan
| Scanned | 2024-09-21T06:29:00+00:00 |
| URL | https://jobatus.es/robots.txt |
| Redirect | https://www.jobatus.es/robots.txt |
| Redirect Domain | www.jobatus.es |
| Redirect Base | jobatus.es |
| Domain IPs | 51.91.153.20 |
| Redirect IPs | 51.91.153.20 |
| Response IP | 51.91.153.20 |
| Found | Yes |
| Hash | cc61864ccf1b2a8dd1724c70aad51c1e0d610c268efe8a2817bc13cb6daf456d |
| SimHash | 0500cba28757 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /rss/ |
| Disallow | /alerts/ |
| Disallow | /ajax_sponsor/ |
| Disallow | /autocomplete/ |
| Disallow | /about |
| Disallow | /legal |
| Disallow | /tus_anuncios_en_jobatus |
| Disallow | /login |
| Disallow | /logout |
| Disallow | /rss/ |
| Disallow | /register/ |
| Disallow | /password/ |
| Disallow | /info_cookies/ |
| Disallow | /ajax_video |
| Disallow | /tag |
| Disallow | /cv/ |