nationalgeographic.com.es
robots.txt
Robots Exclusion Standard data for nationalgeographic.com.es
Resource Scan
Scan Details
Site Domain | nationalgeographic.com.es |
Base Domain | nationalgeographic.com.es |
Scan Status | Ok |
Last Scan | 2024-05-15T01:15:16+00:00 |
Next Scan | 2024-05-22T01:15:16+00:00 |
Last Scan
Scanned | 2024-05-15T01:15:16+00:00 |
URL | https://nationalgeographic.com.es/robots.txt |
Redirect | https://www.nationalgeographic.com.es/robots.txt |
Redirect Domain | www.nationalgeographic.com.es |
Redirect Base | nationalgeographic.com.es |
Domain IPs | 20.50.2.27 |
Redirect IPs | 184.87.193.89, 184.87.193.90 |
Response IP | 42.99.140.177 |
Found | Yes |
Hash | 481c502ff08bdd27d232368ed4db91b3a795f7a8aec2f02f3a3e6d7ef4860c7b |
SimHash | a874184aa562 |
Groups
*
Rule | Path |
---|---|
Disallow | /usuarios/ |
Disallow | /club/ |
Disallow | /comunes/ |
Disallow | /login.html |
Disallow | /buscador |
Disallow | /suscripciones/ |
Disallow | /promociones |
Disallow | /boletin/ |
Disallow | /fotografia/hemeroteca-de-foto-del-dia |
Disallow | /*/%7B%7Blink%7D%7D$ |
Disallow | /*/%7B%7Burl%7D%7D$ |
Disallow | /articulo.aspx |
Disallow | /feeds |