b24.co
robots.txt
Robots Exclusion Standard data for b24.co
Resource Scan
Scan Details
| Site Domain | b24.co |
| Base Domain | b24.co |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-09-22T06:49:25+00:00 |
| Next Scan | 2024-12-21T06:49:25+00:00 |
Last Successful Scan
| Scanned | 2024-02-03T00:10:48+00:00 |
| URL | https://b24.co/robots.txt |
| Domain IPs | 5.148.168.160 |
| Response IP | 5.148.168.160 |
| Found | Yes |
| Hash | 0f4036a92a38767ff584ec32e8e534f6426449b08fa0322fd00fcd5f78a58808 |
| SimHash | 52080cd89468 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /rss/ |
| Disallow | /app/ |
| Disallow | /modal/ |
| Disallow | /send/ |
| Disallow | /print/ |
| Disallow | /ical/ |
| Disallow | /ins/ |
| Disallow | /favorites/ |
| Disallow | /fotopopup/ |
| Disallow | /redirect/ |
| Disallow | /pdf/ins/ |
| Disallow | /pdf/upload/ |
| Disallow | /haendlerseite/ |
| Disallow | /user/connectlisting/ |
| Disallow | /alinghi/ |
| Disallow | /robot/ |
yandex
baiduspider
ia_archiver
amazonbot
seekbot
seekportbot
pompos
solomono
mj12bot
linguee
lwnutch
magpie-crawler
riddlerbot
discoverybot
seokicks
seokicks-robot
endeca webcrawler
blexbot
yisouspider
httrack website copier
sentibot
trendictionbot
contextad bot
umbot
rubrikkbot
admantx
scrapy
seodiver
plukkie
xovibot
wesee
psbot
bubing
voltron
proximic
riddler
bnsbot
mnogosearch
um-fc
domaincrawler
cliqzbot
semrushbot
domaincrawler
turnitinbot
bdcbot
searchmetricsbot
petalbot
majesticseo
backlinkcrawler
spbot
ahrefsbot
ia_archiver
turnitinbot
slysearch
findlinks
pixray-seeker
lb-spider
bytespider
relemindbot
httrack
dataforseobot
fidget-spinner-bot
my-tiny-bot
thesis-research-bot
imagesiftbot
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.boot24.ch/sitemap.xml |
Comments