bayerische-spezialitaeten.net
robots.txt

Robots Exclusion Standard data for bayerische-spezialitaeten.net

Resource Scan

Scan Details

Site Domain bayerische-spezialitaeten.net
Base Domain bayerische-spezialitaeten.net
Scan Status Ok
Last Scan2024-11-12T15:36:46+00:00
Next Scan 2024-11-19T15:36:46+00:00

Last Scan

Scanned2024-11-12T15:36:46+00:00
URL https://bayerische-spezialitaeten.net/robots.txt
Redirect https://www.bayerische-spezialitaeten.net/robots.txt
Redirect Domain www.bayerische-spezialitaeten.net
Redirect Base bayerische-spezialitaeten.net
Domain IPs 85.13.156.56
Redirect IPs 85.13.156.56
Response IP 85.13.156.56
Found Yes
Hash 0e9c814df9e4ba134011e86ead7f73b19090a760f2549f7e7cdb31225594fc70
SimHash fd1c8490c7ec

Groups

mediapartners-google*

Rule Path
Disallow

aboutusbot
attentio
betabot
bizinformation
bizzinformation
blowfish/1.0
companyspotter
companyspotter
coolsocialbot
cubestat
dotbot
euripbot
eurobot
flaming attackbot
foobot
grub
grub-client
hloader
ia_archiver
ia_archiver/1.6
kalooga
kenjin spider
lnspiderguy
looksmart
netestate
netestate ne crawler
netestate rss crawler
openbot
pdlmbot
penthesilea
radiation retriever 1.1
scoutjet
searchpreview
sindicebot
spbot
speedy
surveybot
trendscape
updownerbot
url control
url_spider_pro
valuethewebsite
webarbiter
website quester
websiterating
websitewiki
yandex

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.bayerische-spezialitaeten.net/sitemap.xml

Comments

  • robots.txt