miaulario.unavarra.es
robots.txt

Robots Exclusion Standard data for miaulario.unavarra.es

Resource Scan

Scan Details

Site Domain miaulario.unavarra.es
Base Domain unavarra.es
Scan Status Ok
Last Scan2025-05-02T11:44:48+00:00
Next Scan 2025-06-01T11:44:48+00:00

Last Scan

Scanned2025-05-02T11:44:48+00:00
URL https://miaulario.unavarra.es/robots.txt
Domain IPs 130.206.159.234
Response IP 130.206.159.234
Found Yes
Hash 1c3806941d5549f4f2ed022e27bd7c9efd9e0920712fed6f39d98e54d0129c93
SimHash f40d5957c0e4

Groups

amazonbot
anthropic-ai
applebot-extended
awariorssbot
awariosmartbot
bytespider
ccbot
chatgpt-user
claudebot
claude-web
cohere-ai
dataforseobot
diffbot
duckassistbot
facebookbot
friendlycrawler
google-cloudvertexbot
google-extended
google-inspectiontool
googlebot
googlebot-image
googlebot-news
googlebot-video
googleother
googleother-image
googleother-video
storebot-google
gptbot
imagesiftbot
magpie-crawler
meta-externalagent
meta-externalagent
meta-externalfetcher
meta-externalfetcher
newsnow
news-please
oai-searchbot
omgili
omgilibot
peer39_crawler
peer39_crawler/1.0
perplexitybot
quora-bot
scrapy
timpibot
turnitinbot
youbot

Rule Path
Disallow /