farodevigo.es
robots.txt

Robots Exclusion Standard data for farodevigo.es

Resource Scan

Scan Details

Site Domain farodevigo.es
Base Domain farodevigo.es
Scan Status Ok
Last Scan2024-04-30T23:53:15+00:00
Next Scan 2024-05-07T23:53:15+00:00

Last Scan

Scanned2024-04-30T23:53:15+00:00
URL https://farodevigo.es/robots.txt
Redirect https://www.farodevigo.es/robots.txt
Redirect Domain www.farodevigo.es
Redirect Base farodevigo.es
Domain IPs 195.57.161.165
Redirect IPs 199.232.194.133, 199.232.198.133
Response IP 146.75.94.133
Found Yes
Hash a808ae750587b6254623af432a06103c3c1f38e59d7fca3a92c155fb62b3ee34
SimHash c80052d09237

Groups

twitterbot

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

*

Rule Path
Allow /
Disallow /hemeroteca/buscador/
Disallow /motogp/
Disallow /tour-francia/
Allow /ocio/hosteleria/*/pontevedra_m/*_s/
Allow /ocio/hosteleria/*/pontevedra_m/*_p/
Allow /ocio/hosteleria/*/ourense_m/*_s/
Allow /ocio/hosteleria/*/ourense_m/*_p/
Disallow /ocio/hosteleria/*/*_s/
Disallow /ocio/hosteleria/*/*_p/
Disallow /ocio/hosteleria/*/*_m/
Disallow /tags/letra/
Disallow /economia/declaracion-renta/
Disallow /medio-ambiente/

Other Records

Field Value
sitemap https://www.farodevigo.es/sitemap_google_news_246e7.xml
sitemap https://www.farodevigo.es/sitemap_index_246e7.xml