prensaobrera.com
robots.txt
Robots Exclusion Standard data for prensaobrera.com
Resource Scan
Scan Details
Site Domain | prensaobrera.com |
Base Domain | prensaobrera.com |
Scan Status | Ok |
Last Scan | 2024-04-25T13:37:18+00:00 |
Next Scan | 2024-05-25T13:37:18+00:00 |
Last Scan
Scanned | 2024-04-25T13:37:18+00:00 |
URL | https://prensaobrera.com/robots.txt |
Domain IPs | 162.159.140.98, 172.66.0.96, 2606:4700:7::60, 2a06:98c1:58::60 |
Response IP | 162.159.140.98 |
Found | Yes |
Hash | cecbb61dadeafd2aab680b4bed2723dac97be40e48b88ec556ae3bdfd429b78d |
SimHash | 7320bad10fb2 |
Groups
*
Rule | Path |
---|---|
Disallow | /docs/* |
Disallow | /perfil/* |
Disallow | /perfil |
Disallow | /docs |
Disallow | /login |
Disallow | /wp-content/themes/powp/* |
*
Rule | Path |
---|---|
Allow | /seccion/politicas/* |
Allow | /seccion/internacionales/* |
Allow | /seccion/cultura/* |
Allow | /seccion/sindicales/* |
Allow | /seccion/mujer/* |
Allow | /ultimas-noticias |
Other Records
Field | Value |
---|---|
sitemap | https://prensaobrera.com/sitemap.xml |
Warnings
- `host` is not a known field.
Comments