günstiger-reisen.de
robots.txt
Robots Exclusion Standard data for günstiger-reisen.de
Resource Scan
Scan Details
| Site Domain | günstiger-reisen.de |
| Base Domain | günstiger-reisen.de |
| Scan Status | Ok |
| Last Scan | 2024-11-01T03:47:33+00:00 |
| Next Scan | 2024-12-01T03:47:33+00:00 |
Last Scan
| Scanned | 2024-11-01T03:47:33+00:00 |
| URL | https://günstiger-reisen.de/robots.txt |
| Redirect | https://www.xn--gnstiger-reisen-zvb.de/robots.txt |
| Redirect Domain | www.günstiger-reisen.de |
| Redirect Base | günstiger-reisen.de |
| Domain IPs | 188.40.16.70 |
| Redirect IPs | 188.40.16.70 |
| Response IP | 188.40.16.70 |
| Found | Yes |
| Hash | 2628458d479d8059517f446bb9aab0143c757ebcc59d4261b817e41b2532a173 |
| SimHash | 0ee82060c0ea |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /agb |
| Disallow | /datenschutz |
| Disallow | /gewinnspiel |
| Disallow | /ueber-uns |
| Disallow | /reisen |
| Disallow | /termine |
seobility
seobilitybot
| Rule | Path |
|---|---|
| Disallow | /agb |
| Disallow | /datenschutz |
| Disallow | /gewinnspiel |
| Disallow | /ueber-uns |
| Disallow | /reisen |
| Disallow | /termine |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
sistrix
sistrix crawler
yandexbot
| Rule | Path |
|---|---|
| Disallow | /agb |
| Disallow | /datenschutz |
| Disallow | /gewinnspiel |
| Disallow | /ueber-uns |
| Disallow | /reisen |
| Disallow | /termine |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 15 |
ahrefsbot
aihitbot
backlinkcrawler
blexbot
bubing
careerbot
ccbot
cliqzbot
cloudservermarketspider
coccoc
domain re-animator bot
domaincrawler
dotbot
exabot
fr-crawler
haosouspider
iccrawler
implisensebot
indeedbot
jobboersebot
jobs.de-robot
kraken
linguee
linkstats
lipperhey-kaus-australis
magpie-crawler
meanpathbot
megaindex.com
megaindex.ru
metajobbot
mindupbot
mj12bot
netestate
obot
openhosebot
plista
plukkie
python/3.5 aiohttp
qwantify
r6_commentreader
rogerbot
safednsbot
searchmetricsbot
semrushbot
semrushbot-sa
seodiver
seokicks-robot
seoscanners.net
sg-orbiter
spbot
spiderbot
surveybot
thumbsniper
toweya.com bot
trendictionbot
turnitinbot
um-ic
unisterbot
wbsearchbot
wotbox
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.xn--gnstiger-reisen-zvb.de/sitemap.xml |
Warnings
- 1 invalid line.