uvinum.es
robots.txt

Robots Exclusion Standard data for uvinum.es

Resource Scan

Scan Details

Site Domain uvinum.es
Base Domain uvinum.es
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-08-24T03:11:08+00:00
Next Scan 2024-11-22T03:11:08+00:00

Last Successful Scan

Scanned2022-10-08T16:42:50+00:00
URL https://uvinum.es/robots.txt
Redirect https://www.drinksco.es/robots.txt
Redirect Domain www.drinksco.es
Redirect Base drinksco.es
Response IP 52.215.112.134, 34.250.72.140, 54.77.187.255
Found Yes
Hash 92763d065c3f3856e7e182ccd62ff11ed28a36d3202e9bb33272a60af7a372c1
SimHash e314e003ebbb

Groups

*

Rule Path
Disallow /header-tabs-ajax
Disallow /connect-authorize
Disallow /connect-callback
Disallow /connect-unlink
Disallow /bodegas-plus
Disallow /tracking.json
Disallow /load-module
Disallow /1%3Ak%3A1
Disallow /*_s%3A
Disallow /s$
Disallow /*%2C*%2C
Disallow /*%3As%3A
Disallow /*%3Ah%3A
Disallow /store
Disallow /checkout
Disallow /*/precio%3A
Disallow /*/precio/*
Disallow *search%3D*
Disallow *?opinions*
Disallow *?*maker=
Disallow *?*sparkling_color=
Disallow *?*badges=
Disallow *?*sort=
Disallow *?*price
Allow /*/precio%3AES
Disallow /*/2271556/
Disallow /ajax-*
Allow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

lcc

Rule Path
Disallow /

bubing

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

petalbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

Comments

  • Prevent Google DFP problems.
  • http://corpora.informatik.uni-leipzig.de/crawler_faq.html
  • http://law.di.unimi.it/BUbiNG.html