Log In Sign Up

imtrading.de
robots.txt

Robots Exclusion Standard data for imtrading.de

Resource Scan

Scan Details

Site Domain imtrading.de
Base Domain imtrading.de
Scan Status Ok
Last Scan2025-11-04T01:37:14+00:00
Next Scan 2025-12-04T01:37:14+00:00

Last Scan

Scanned2025-11-04T01:37:14+00:00
URL https://imtrading.de/robots.txt
Domain IPs 2001:4ce0:6:25::99, 81.90.39.60
Response IP 81.90.39.60
Found Yes
Hash 9e52e473e1de60bbe4d4ca66fcdd237d0b9bc5b96ee89609e183b15e493b0156
SimHash 609cd8a561c6

Groups

dataforseobot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

googlebot-image

Rule Path
Disallow /media/image/

idealo-bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15
Back to top

Other Records

Field Value
sitemap https://imtrading.de/sitemap_index.xml
Back to top

Comments

  • Bekannte aggressive Bots blockieren
  • Googlebot einschränken (aber nicht ganz blockieren, wenn SEO wichtig ist)
  • Idealo-Bot einschränken, wenn gewünscht
  • Alle anderen Bots stark verlangsamen
Back to top