avl.gva.es
robots.txt

Robots Exclusion Standard data for avl.gva.es

Resource Scan

Scan Details

Site Domain avl.gva.es
Base Domain gva.es
Scan Status Ok
Last Scan2025-07-16T06:36:19+00:00
Next Scan 2025-08-15T06:36:19+00:00

Last Scan

Scanned2025-07-16T06:36:19+00:00
URL https://avl.gva.es/robots.txt
Domain IPs 193.145.205.52, 195.77.16.142
Response IP 193.145.205.52
Found Yes
Hash f1b06368b86625f7c630ff4ffcf60095fbf61587ccdf8255f5cd22afbd0fc440
SimHash 6d5f9942a7c8

Groups

*

Rule Path
Disallow /biblioteca/
Disallow /bi

claudebot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

googlebot

Rule Path
Disallow /biblioteca/

bingbot

Rule Path
Disallow /biblioteca/

yandex

Rule Path
Disallow /biblioteca/

baiduspider

Rule Path
Disallow /

duckduckbot

Rule Path
Disallow /biblioteca/

Other Records

Field Value
sitemap https://www.avl.gva.es/sitemap.xml

Comments

  • Bloc per a tots els robots
  • Bloc ClaudeBot i altres bots similars
  • Afegim altres bots que podrien estar causant trĂ nsit
  • Sitemap

Warnings

  • 4 invalid lines.