Log In Sign Up

creonect.com
robots.txt

Robots Exclusion Standard data for creonect.com

Resource Scan

Scan Details

Site Domain creonect.com
Base Domain creonect.com
Scan Status Ok
Last Scan2026-01-01T19:02:09+00:00
Next Scan 2026-01-31T19:02:09+00:00

Last Scan

Scanned2026-01-01T19:02:09+00:00
URL https://creonect.com/robots.txt
Redirect https://www.creonect.com/robots.txt
Redirect Domain www.creonect.com
Redirect Base creonect.com
Domain IPs 81.19.159.43
Redirect IPs 81.19.159.43
Response IP 81.19.159.43
Found Yes
Hash e9a0b50208007c532ce8b806363ee65ac05f68a21e3e59ab8e91b01cbe92fb0c
SimHash 2194dd136390

Groups

*

Rule Path
Allow /

*

Rule Path
Allow /*.css$
Allow /*.js$
Allow /*.jpg$
Allow /*.jpeg$
Allow /*.png$
Allow /*.gif$
Allow /*.svg$
Allow /*.webp$

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 0

googlebot-image

Rule Path
Allow /

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 0

yandex

Rule Path
Allow /

duckduckbot

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.creonect.com/sitemap.xml
Back to top

Comments

  • robots.txt for creonect GmbH
  • Generated: 2025-12-25
  • Allow all search engines to crawl the site
  • Sitemap location
  • Disallow crawling of certain file types (if any)
  • Uncomment these if you have admin, config, or temp directories
  • Disallow: /admin/
  • Disallow: /config/
  • Disallow: /temp/
  • Disallow: /private/
  • Allow crawling of CSS and JavaScript for better rendering
  • Allow all images
  • Crawl-delay (optional - only if you have server load issues)
  • Crawl-delay: 1
  • Specific rules for major search engines
  • Google
  • Google Images
  • Bing
  • Yandex
  • DuckDuckGo
  • Block bad bots (optional - uncomment if you have issues with these)
  • User-agent: AhrefsBot
  • Disallow: /
  • User-agent: SemrushBot
  • Disallow: /
  • User-agent: MJ12bot
  • Disallow: /
  • User-agent: dotbot
  • Disallow: /
Back to top