bd.trabajo.org
robots.txt
Robots Exclusion Standard data for bd.trabajo.org
Resource Scan
Scan Details
| Site Domain | bd.trabajo.org |
| Base Domain | trabajo.org |
| Scan Status | Ok |
| Last Scan | 2026-03-17T04:11:57+00:00 |
| Next Scan | 2026-04-16T04:11:57+00:00 |
Last Scan
| Scanned | 2026-03-17T04:11:57+00:00 |
| URL | https://bd.trabajo.org/robots.txt |
| Domain IPs | 2600:9000:2837:1e00:19:e330:c4c0:93a1, 2600:9000:2837:3200:19:e330:c4c0:93a1, 2600:9000:2837:5e00:19:e330:c4c0:93a1, 2600:9000:2837:6e00:19:e330:c4c0:93a1, 2600:9000:2837:800:19:e330:c4c0:93a1, 2600:9000:2837:8a00:19:e330:c4c0:93a1, 2600:9000:2837:a000:19:e330:c4c0:93a1, 2600:9000:2837:fe00:19:e330:c4c0:93a1, 3.169.71.118, 3.169.71.26, 3.169.71.50, 3.169.71.72 |
| Response IP | 3.169.71.26 |
| Found | Yes |
| Hash | 4bc5834b898d0e0c47563620bde9240d6ce27151dc6d24366cd13c660544f981 |
| SimHash | 701099d1e5c1 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /css/ |
| Allow | /js/ |
| Allow | /fonts/ |
| Allow | /img/ |
| Allow | /libraries/bootstrap/ |
| Disallow | /njob/ |
| Disallow | /ajax/ |
| Disallow | /redirect/ |
| Disallow | /publish/ |
| Disallow | /premium/checkout/ |
| Disallow | /alerts/ |
| Disallow | /backend/ |
| Disallow | /backendv2/ |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://sitemaps.trabajo.org/index.xml |
| sitemap | https://sitemaps.trabajo.org/bd/index.xml |
Comments