cosmeterie.com
robots.txt

Robots Exclusion Standard data for cosmeterie.com

Resource Scan

Scan Details

Site Domain cosmeterie.com
Base Domain cosmeterie.com
Scan Status Ok
Last Scan2025-11-23T15:38:02+00:00
Next Scan 2025-11-30T15:38:02+00:00

Last Scan

Scanned2025-11-23T15:38:02+00:00
URL https://cosmeterie.com/robots.txt
Redirect https://www.cosmeterie.com/robots.txt
Redirect Domain www.cosmeterie.com
Redirect Base cosmeterie.com
Domain IPs 148.251.119.201
Redirect IPs 148.251.119.201
Response IP 148.251.119.201
Found Yes
Hash 0edffa58747e978153effdefc2f130dab206f3ff1bf7e48355bbd2c863ab8e9d
SimHash 063e5ac2aa93

Groups

w2gbot

Rule Path
Disallow /

sputnikbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

sogou
sogou-image
sogou-video

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

baiduspider
baiduspider-image
baiduspider-news
baiduspider-video

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

*

Rule Path
Disallow /kunden/*
Disallow /webshop/*

Other Records

Field Value
sitemap https://www.cosmeterie.com/sitemap-c.xml
sitemap https://www.cosmeterie.com/sitemap-cs.xml
sitemap https://www.cosmeterie.com/sitemap-p.xml
sitemap https://www.cosmeterie.com/sitemap-p404.xml
sitemap https://www.cosmeterie.com/sitemap-i.xml
sitemap https://www.cosmeterie.com/sitemap-sp.xml
sitemap https://www.cosmeterie.com/sitemap-r.xml
sitemap https://www.cosmeterie.com/update.rss

Comments

  • robots.txt

Warnings

  • 4 invalid lines.