oh-barcelona.com
robots.txt

Robots Exclusion Standard data for oh-barcelona.com

Resource Scan

Scan Details

Site Domain oh-barcelona.com
Base Domain oh-barcelona.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-10-17T14:26:06+00:00
Next Scan 2025-01-15T14:26:06+00:00

Last Successful Scan

Scanned2023-11-30T12:20:57+00:00
URL https://oh-barcelona.com/robots.txt
Redirect https://www.oh-barcelona.com/robots.txt
Redirect Domain www.oh-barcelona.com
Redirect Base oh-barcelona.com
Domain IPs 82.223.69.117
Redirect IPs 82.223.69.117
Response IP 82.223.69.117
Found Yes
Hash 29a054f1d1586eb08dedde97c8dc179c82e6c74059defcdcbe6c0b9fecf9a4c4
SimHash 1014c1faca03

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /index.php5*
Disallow /ecos/
Disallow /ECOS/
Disallow /util/
Disallow /en/s/
Disallow /es/s/
Disallow /de/s/
Disallow /fr/s/
Disallow /it/s/
Disallow /nl/s/
Disallow /en/c/
Disallow /es/c/
Disallow /de/c/
Disallow /fr/c/
Disallow /it/c/
Disallow /nl/c/
Disallow /en/secure/
Disallow /es/secure/
Disallow /de/secure/
Disallow /fr/secure/
Disallow /it/secure/
Disallow /nl/secure/
Disallow /en/mybooking/
Disallow /es/mybooking/
Disallow /de/mybooking/
Disallow /fr/mybooking/
Disallow /it/mybooking/
Disallow /nl/mybooking/
Disallow /static/
Disallow /images/
Disallow /webservices/
Disallow /en/favourites/
Disallow /es/favoritos/
Disallow /fr/favoris/
Disallow /de/favoriten/
Disallow /it/preferiti/
Disallow /nl/favoriten/
Disallow /es/blog/wp-content/
Disallow /en/blog/wp-content/
Disallow /de/blog/wp-content/
Disallow /fr/blog/wp-content/
Disallow /it/blog/wp-content/
Disallow /nl/blog/wp-content/
Disallow /es/blog/wp-admin/
Disallow /en/blog/wp-admin/
Disallow /de/blog/wp-admin/
Disallow /fr/blog/wp-admin/
Disallow /it/blog/wp-admin/
Disallow /nl/blog/wp-admin/
Disallow /it/hotel-barcellona/%HNM%
Disallow /fr/hotels-barcelone/%HNM%
Disallow /es/hoteles-barcelona/%HNM%
Disallow /en/barcelona-hotels/%HNM%
Disallow /de/hotels-barcelona/%HNM%

exabot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

npbot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

larbin

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

httrack

Rule Path
Disallow /

superbot

Rule Path
Disallow /

gaisbot

Rule Path
Disallow /

henrythemiragorobot

Rule Path
Disallow /

bumblebee@relevare.com

Rule Path
Disallow /

true_robot/1.0

Rule Path
Disallow /

true_robot

Rule Path
Disallow /

szukacz/1.4

Rule Path
Disallow /

zeus

Rule Path
Disallow /

zeus 32297 webster pro v2.9 win32

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

voyager/1.0

Rule Path
Disallow /

mj12bot/v1.0.7 (http://majestic12.co.uk/bot.php?+) [^] [^]

Rule Path
Disallow /

aspider/0.09

Rule Path
Disallow /

appie 1.1 (www.walhello.com)

Rule Path
Disallow /

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

baiduspider-image

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

baiduspider-video

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

baiduspider-news

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

baiduspider-favo

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

baiduspider-cpro

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

baiduspider-ads

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

baidu

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap http://www.oh-barcelona.com/sitemap.xml