beautybad.de
robots.txt
Robots Exclusion Standard data for beautybad.de
Resource Scan
Scan Details
Site Domain | beautybad.de |
Base Domain | beautybad.de |
Scan Status | Ok |
Last Scan | 2024-11-11T14:13:28+00:00 |
Next Scan | 2024-11-18T14:13:28+00:00 |
Last Scan
Scanned | 2024-11-11T14:13:28+00:00 |
URL | https://beautybad.de/robots.txt |
Redirect | https://www.beautybad.de/robots.txt |
Redirect Domain | www.beautybad.de |
Redirect Base | beautybad.de |
Domain IPs | 85.13.153.213 |
Redirect IPs | 85.13.153.213 |
Response IP | 85.13.153.213 |
Found | Yes |
Hash | 0ac54c3c417326a2166e0cc36e72620b93cfd5dead6bde3e496f2f3beab92a97 |
SimHash | fd1c8490c7ac |
Groups
aboutusbot
attentio
betabot
bizinformation
bizzinformation
blowfish/1.0
companyspotter
companyspotter
coolsocialbot
cubestat
dotbot
euripbot
eurobot
flaming attackbot
foobot
grub
grub-client
hloader
ia_archiver
ia_archiver/1.6
kalooga
kenjin spider
lnspiderguy
looksmart
netestate
netestate ne crawler
netestate rss crawler
openbot
pdlmbot
penthesilea
radiation retriever 1.1
scoutjet
searchpreview
sindicebot
spbot
speedy
surveybot
trendscape
updownerbot
url control
url_spider_pro
valuethewebsite
webarbiter
website quester
websiterating
websitewiki
yandex
Rule | Path |
---|---|
Disallow | / |
Other Records
Field | Value |
---|---|
sitemap | https://www.beautybad.de/sitemap.xml |
Comments