hotelspecials.nl
robots.txt

Robots Exclusion Standard data for hotelspecials.nl

Resource Scan

Scan Details

Site Domain hotelspecials.nl
Base Domain hotelspecials.nl
Scan Status Ok
Last Scan2024-05-22T04:35:43+00:00
Next Scan 2024-06-21T04:35:43+00:00

Last Scan

Scanned2024-05-22T04:35:43+00:00
URL https://www.hotelspecials.nl/robots.txt
Domain IPs 18.161.6.127, 18.161.6.65, 18.161.6.72, 18.161.6.91, 2600:9000:2364:3200:15:7b48:6b00:93a1, 2600:9000:2364:7800:15:7b48:6b00:93a1, 2600:9000:2364:8e00:15:7b48:6b00:93a1, 2600:9000:2364:bc00:15:7b48:6b00:93a1, 2600:9000:2364:be00:15:7b48:6b00:93a1, 2600:9000:2364:c800:15:7b48:6b00:93a1, 2600:9000:2364:dc00:15:7b48:6b00:93a1, 2600:9000:2364:fa00:15:7b48:6b00:93a1
Response IP 108.157.60.16
Found Yes
Hash 8676db63620e12312783e54fe84e4570814c4652ff634732edad4ca65b0ad859
SimHash 4108dd60f95f

Groups

ahrefsbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandexdirect

Rule Path
Disallow /

npbot-1/2.0

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

spbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

*

Rule Path
Disallow /*/2-nachten-1-betalen
Disallow /*/3-nachten-2-betalen
Disallow /*/4-nachten-3-betalen
Disallow /*/48h-specials
Disallow /*/5-nachten-4-betalen
Disallow /*/6-nachten-4-betalen
Disallow /*/7-nachten-5-betalen
Disallow /*/all-inclusive-special
Disallow /*/city-specials
Disallow /*/diner-specials
Disallow /*/family-specials
Disallow /*/feel-fabulous-specials
Disallow /*/fiets-specials
Disallow /*/halfpension-specials
Disallow /*/high-tea-specials
Disallow /*/hotelweek-4-sterren-vip-upgrade
Disallow /*/hotelweek-5-sterren
Disallow /*/hotelweek-5-sterren-vip-upgrade
Disallow /*/hotelweek-specials
Disallow /*/huisdier-gratis
Disallow /*/kerstmarkt-2-nachten-1-betalen
Disallow /*/kerstmarkt-3-nachten-2-betalen
Disallow /*/kerstmarkt-specials
Disallow /*/kerstmarkt-vip-upgrade-specials
Disallow /*/last-minute-specials
Disallow /*/romantisch-weekendje-weg
Disallow /*/romantisch-weekendje-weg-deluxe
Disallow /*/secret-specials
Disallow /*/spa-specials
Disallow /*/suite-specials
Disallow /*/super-last-minute-specials
Disallow /*/topdeals
Disallow /*/vip-upgrade
Disallow /*/voordeel-specials
Disallow /*/weekendje-weg-deluxe
Disallow /*/wellness-specials
Disallow /search
Disallow /booking-calendar
Disallow /debug
Disallow *?t=*
Disallow *%26t%3D*
Disallow *?adults*
Disallow *reviews-group%3D*
Disallow *children%3D*
Disallow *?si=*
Disallow *?si

Other Records

Field Value
sitemap https://www.hotelspecials.nl/xmlsitemap

Warnings

  • `noindex` is not a known field.