Log In Sign Up

kremerpigments.com
robots.txt

Robots Exclusion Standard data for kremerpigments.com

Resource Scan

Scan Details

Site Domain kremerpigments.com
Base Domain kremerpigments.com
Scan Status Ok
Last Scan2024-09-28T02:42:26+00:00
Next Scan 2024-10-28T02:42:26+00:00

Last Scan

Scanned2024-09-28T02:42:26+00:00
URL https://kremerpigments.com/robots.txt
Redirect https://shop.kremerpigments.com/robots.txt
Redirect Domain shop.kremerpigments.com
Redirect Base kremerpigments.com
Domain IPs 104.26.0.132, 104.26.1.132, 172.67.74.149, 2606:4700:20::681a:184, 2606:4700:20::681a:84, 2606:4700:20::ac43:4a95
Redirect IPs 104.26.0.132, 104.26.1.132, 172.67.74.149, 2606:4700:20::681a:184, 2606:4700:20::681a:84, 2606:4700:20::ac43:4a95
Response IP 104.26.1.132
Found Yes
Hash 90e97b77e3ec39aab08a49e2f6b35d1ed9cc1a99f89964ce5b812430a829b8dc
SimHash 4b55cd191ed1

Groups

barkrowler
petalbot
ltx71 - (http://ltx71.com/)
serpstatbot
ltx71
blexbot
megaindex.ru
serpstatbot
semrushbot
obot
coccocbot-web
seobility
semrushbot-sa
ahrefsbot
seokicks
magpie-crawler
dotbot
lcc
yasni
pipl
myonid
mj12bot
alphaseobot
alphaseobot-sa
ccbot
exabot
cliqzbot
clarabot
zoominfobot

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /elements/products/micro/
Disallow /elements/products/small/
Disallow /elements/products/original/
Back to top

Other Records

Field Value
sitemap https://www.kremer-pigmente.com/sitemap.xml
sitemap https://www.kremer-pigmente.com/sitemapMobile.xml
Back to top

Comments

  • User-Agent: *
  • Disallow: /elements/resources/products/files/VG_*
Back to top

Warnings

  • 1 invalid line.
Back to top