Log In Sign Up

kremer-pigmente.com
robots.txt

Robots Exclusion Standard data for kremer-pigmente.com

Resource Scan

Scan Details

Site Domain kremer-pigmente.com
Base Domain kremer-pigmente.com
Scan Status Ok
Last Scan2024-10-28T08:00:33+00:00
Next Scan 2024-11-27T08:00:33+00:00

Last Scan

Scanned2024-10-28T08:00:33+00:00
URL https://kremer-pigmente.com/robots.txt
Domain IPs 104.26.6.166, 104.26.7.166, 172.67.73.196, 2606:4700:20::681a:6a6, 2606:4700:20::681a:7a6, 2606:4700:20::ac43:49c4
Response IP 104.26.6.166
Found Yes
Hash 90e97b77e3ec39aab08a49e2f6b35d1ed9cc1a99f89964ce5b812430a829b8dc
SimHash 4b55cd191ed1

Groups

barkrowler
petalbot
ltx71 - (http://ltx71.com/)
serpstatbot
ltx71
blexbot
megaindex.ru
serpstatbot
semrushbot
obot
coccocbot-web
seobility
semrushbot-sa
ahrefsbot
seokicks
magpie-crawler
dotbot
lcc
yasni
pipl
myonid
mj12bot
alphaseobot
alphaseobot-sa
ccbot
exabot
cliqzbot
clarabot
zoominfobot

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /elements/products/micro/
Disallow /elements/products/small/
Disallow /elements/products/original/
Back to top

Other Records

Field Value
sitemap https://www.kremer-pigmente.com/sitemap.xml
sitemap https://www.kremer-pigmente.com/sitemapMobile.xml
Back to top

Comments

  • User-Agent: *
  • Disallow: /elements/resources/products/files/VG_*
Back to top

Warnings

  • 1 invalid line.
Back to top