uitvaartgids.be
robots.txt
Robots Exclusion Standard data for uitvaartgids.be
Resource Scan
Scan Details
| Site Domain | uitvaartgids.be |
| Base Domain | uitvaartgids.be |
| Scan Status | Ok |
| Last Scan | 2024-11-15T16:41:48+00:00 |
| Next Scan | 2024-11-22T16:41:48+00:00 |
Last Scan
| Scanned | 2024-11-15T16:41:48+00:00 |
| URL | https://uitvaartgids.be/robots.txt |
| Domain IPs | 164.138.223.117 |
| Response IP | 164.138.223.117 |
| Found | Yes |
| Hash | 2f6e569976d59237ce213206d415a1de20ef4490276fe5465370e53a2078688f |
| SimHash | 2316c7124090 |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Allow | / |
applebot
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Allow | / |
bingbot
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Allow | / |
msnbot
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Allow | / |
slurp
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Allow | / |
googlebot-image
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Allow | / |
baiduspider
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Allow | / |
seznambot
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Allow | / |
teoma
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Allow | / |
yandex
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Allow | / |
yeti
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Allow | / |
msnbot-media
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Allow | / |
googlebot-news
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Allow | / |
googlebot-video
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Allow | / |
googlebot-mobile
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Allow | / |
mediapartners-google
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Allow | / |
adsbot-google
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Allow | / |
duckduckbot
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Allow | / |
daumoa
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Allow | / |
orangebot
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Allow | / |
orangebot-collector
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Allow | / |
stackrambler
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Allow | / |
twitterbot/1.0
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Allow | / |
mail.ru_bot
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Allow | / |
naverbot
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Allow | / |
foobot
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Allow | / |
db4bot
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Allow | / |
vebidoobot
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Allow | / |
mj12bot
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Allow | / |
sogou
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Allow | / |
deepcrawl
| Rule | Path |
|---|---|
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Allow | / |
*
| Rule | Path |
|---|---|
| Disallow | / |
Warnings
- 9 invalid lines.
Comments