latribuna.cl
robots.txt
Robots Exclusion Standard data for latribuna.cl
Resource Scan
Scan Details
Site Domain | latribuna.cl |
Base Domain | latribuna.cl |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-12T00:02:44+00:00 |
Next Scan | 2024-12-11T00:02:44+00:00 |
Last Successful Scan
Scanned | 2022-11-16T02:54:48+00:00 |
URL | https://latribuna.cl/robots.txt |
Redirect | https://www.latribuna.cl/robots.txt |
Redirect Domain | www.latribuna.cl |
Redirect Base | latribuna.cl |
Response IP | 104.21.90.225, 172.67.205.174 |
Found | Yes |
Hash | f8b163ea934c10ec998f4b4209e9209ab81727d92b7a6bba46bb10ce9e1ca138 |
SimHash | 880dde12a733 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /corporate/recruit/ |
Disallow | /original5.html |
Disallow | /ja/home/ |
Disallow | /pdf/teikan201904.pdf |
Disallow | /products-list06.html |
Disallow | /products-11kigou.html |
Disallow | /diario/ |
Disallow | /subcategory/ |
Disallow | /products-list06.html |
Disallow | /pdf/crack.pdf |
Other Records
Field | Value |
---|---|
sitemap | https://www.latribuna.cl/sitemap.xml |
sitemap | https://www.latribuna.cl/news-sitemap.xml |