insel-sylt.de
robots.txt

Robots Exclusion Standard data for insel-sylt.de

Resource Scan

Scan Details

Site Domain insel-sylt.de
Base Domain insel-sylt.de
Scan Status Ok
Last Scan2025-04-25T21:53:22+00:00
Next Scan 2025-05-25T21:53:22+00:00

Last Scan

Scanned2025-04-25T21:53:22+00:00
URL https://insel-sylt.de/robots.txt
Redirect https://www.insel-sylt.de/robots.txt
Redirect Domain www.insel-sylt.de
Redirect Base insel-sylt.de
Domain IPs 23.88.92.144
Redirect IPs 3.121.144.47, 3.124.197.134
Response IP 3.124.197.134
Found Yes
Hash 4cfc02623d7b02870c0a5c67d2a76056b7227b43834bd0a54f33b098528ab6fb
SimHash 2d097bb5e2d1

Groups

googlebot
googlebot-video
googlebot-news
googlebot-image
adsbot-google
adsbot-google-mobile
apis-google
google-inspectiontool
bingbot
adidxbot
bingpreview
duckduckbot
yandexbot
facebot
facebookexternalhit/1.1
facebookexternalhit/1.0 (+http://www.facebook.com/externalhit_uatext.php)
facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
baiduspider
baiduspider-image
baiduspider-video
baiduspider-news
mozilla/5.0 (compatible; qwantify/bleriot/1.1; +https://help.qwant.com/bot)
qwantbot
bleriot
qwantify
applebot
exabot
chatgpt-user
gptbot
amazonbot
slurp
hubspot crawler
semrushbot

Rule Path
Disallow */wp-admin/
Allow */wp-admin/*.css$
Allow */wp-admin/*.js$
Disallow */category/
Disallow */tag/
Disallow */trackback/
Disallow */feed/
Disallow */comments/

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://webapi.deskline.net/inselsylt/de/accommodations/sitemap.xml?baseurl=https://www.insel-sylt.de/unterkuenfte/unterkuenfte/&changefreq=daily&priority=0.9
sitemap https://webapi.deskline.net/inselsylt/de/events/sitemap.xml?baseurl=https://www.insel-sylt.de/veranstaltungen/veranstaltungen/&changefreq=daily&priority=0.9
sitemap https://webapi.deskline.net/inselsylt/de/addservices/sitemap.xml?baseurl=https://www.insel-sylt.de/erlebnisse/erlebnisse/&changefreq=daily&priority=0.9
sitemap https://www.insel-sylt.de/sitemap.xml