ca.trabajo.org
robots.txt
Robots Exclusion Standard data for ca.trabajo.org
Resource Scan
Scan Details
| Site Domain | ca.trabajo.org |
| Base Domain | trabajo.org |
| Scan Status | Ok |
| Last Scan | 2026-03-30T17:38:52+00:00 |
| Next Scan | 2026-04-29T17:38:52+00:00 |
Last Scan
| Scanned | 2026-03-30T17:38:52+00:00 |
| URL | https://ca.trabajo.org/robots.txt |
| Domain IPs | 2600:9000:2837:0:19:e330:c4c0:93a1, 2600:9000:2837:2c00:19:e330:c4c0:93a1, 2600:9000:2837:3200:19:e330:c4c0:93a1, 2600:9000:2837:9c00:19:e330:c4c0:93a1, 2600:9000:2837:a000:19:e330:c4c0:93a1, 2600:9000:2837:a800:19:e330:c4c0:93a1, 2600:9000:2837:b200:19:e330:c4c0:93a1, 2600:9000:2837:d000:19:e330:c4c0:93a1, 3.165.239.124, 3.165.239.7, 3.165.239.8, 3.165.239.9 |
| Response IP | 3.169.71.26 |
| Found | Yes |
| Hash | abe2aecc0a9dfad42d5a179c3dc4d013e56dbb46b117788278d2502a38992881 |
| SimHash | 781099d1e591 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /css/ |
| Allow | /js/ |
| Allow | /fonts/ |
| Allow | /img/ |
| Allow | /libraries/bootstrap/ |
| Disallow | /njob/ |
| Disallow | /ajax/ |
| Disallow | /redirect/ |
| Disallow | /publish/ |
| Disallow | /premium/checkout/ |
| Disallow | /alerts/ |
| Disallow | /backend/ |
| Disallow | /backendv2/ |
| Disallow | /preview/ |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://sitemaps.trabajo.org/index.xml |
Comments