boat24.com
robots.txt
Robots Exclusion Standard data for boat24.com
Resource Scan
Scan Details
| Site Domain | boat24.com |
| Base Domain | boat24.com |
| Scan Status | Ok |
| Last Scan | 2024-09-22T06:27:23+00:00 |
| Next Scan | 2024-09-29T06:27:23+00:00 |
Last Scan
| Scanned | 2024-09-22T06:27:23+00:00 |
| URL | https://boat24.com/robots.txt |
| Domain IPs | 172.66.40.57, 172.66.43.199, 2606:4700:3108::ac42:2839, 2606:4700:3108::ac42:2bc7 |
| Response IP | 172.66.40.57 |
| Found | Yes |
| Hash | 153256f3baa105786004567a97adb6b83da5891a736130fa049495e278075a25 |
| SimHash | 5a481c589540 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /app/ |
| Disallow | /modal/ |
| Disallow | /send/ |
| Disallow | /print/ |
| Disallow | /ical/ |
| Disallow | /ins/ |
| Disallow | /favorites/ |
| Disallow | /fotopopup/ |
| Disallow | /redirect/ |
| Disallow | /pdf/ins/ |
| Disallow | /pdf/upload/ |
| Disallow | /haendlerseite/ |
| Disallow | /user/connectlisting/ |
| Disallow | /alinghi/ |
| Disallow | /robot/ |
| Disallow | /share/ |
| Disallow | /report/ |
yandex
baiduspider
ia_archiver
amazonbot
seekbot
seekportbot
pompos
solomono
mj12bot
linguee
lwnutch
magpie-crawler
riddlerbot
discoverybot
seokicks
seokicks-robot
endeca webcrawler
blexbot
yisouspider
httrack website copier
sentibot
trendictionbot
contextad bot
umbot
rubrikkbot
admantx
scrapy
seodiver
plukkie
xovibot
wesee
psbot
bubing
voltron
proximic
riddler
bnsbot
mnogosearch
um-fc
domaincrawler
cliqzbot
semrushbot
domaincrawler
turnitinbot
bdcbot
searchmetricsbot
petalbot
majesticseo
backlinkcrawler
spbot
ahrefsbot
ia_archiver
turnitinbot
slysearch
findlinks
pixray-seeker
lb-spider
bytespider
relemindbot
httrack
dataforseobot
fidget-spinner-bot
my-tiny-bot
thesis-research-bot
imagesiftbot
geedobot
awariobot
claudebot
gptbot
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.boat24.com/sitemap.xml |
Comments