valenciacf.lasprovincias.es
robots.txt

Robots Exclusion Standard data for valenciacf.lasprovincias.es

Resource Scan

Scan Details

Site Domain valenciacf.lasprovincias.es
Base Domain lasprovincias.es
Scan Status Ok
Last Scan2024-06-19T16:40:38+00:00
Next Scan 2024-07-19T16:40:38+00:00

Last Scan

Scanned2024-06-19T16:40:38+00:00
URL https://valenciacf.lasprovincias.es/robots.txt
Domain IPs 23.52.40.48, 23.52.40.49
Response IP 23.52.40.33
Found Yes
Hash 1f0a4b6bea728ce9957d50adc600644877d83806bccf1398a1fc5098ddc287a1
SimHash 0a08de54e331

Groups

mediapartners-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /modulos/
Disallow /includes/
Disallow /*?ns_
Disallow /4900/webm.LASPROVINCIAS/
Disallow /4900/vocento.lasprovincias/

Other Records

Field Value
sitemap http://valenciacf.lasprovincias.es/sitemap.xml
sitemap http://valenciacf.lasprovincias.es/sitemap.incremental.xml

Comments

  • Robots valenciacf.lasprovincias.es
  • Sitemaps
  • User Agents