Log In Sign Up

imrtec.com
robots.txt

Robots Exclusion Standard data for imrtec.com

Resource Scan

Scan Details

Site Domain imrtec.com
Base Domain imrtec.com
Scan Status Ok
Last Scan2025-10-31T06:56:04+00:00
Next Scan 2025-11-07T06:56:04+00:00

Last Scan

Scanned2025-10-31T06:56:04+00:00
URL https://imrtec.com/robots.txt
Domain IPs 2a02:4780:15:e97a:8f1a:e7f3:ef5b:e159, 2a02:4780:38:a7fa:2389:9f90:2fa7:bb57, 77.37.115.96, 91.108.100.199
Response IP 191.101.228.97
Found Yes
Hash e8f523dbdc2a1dd748f02fa2290faf21f7d6a55e6e470194572e9fe6c1089161
SimHash 411cceb27791

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

bingbot

Rule Path
Disallow

slurp

Rule Path
Disallow

duckduckbot

Rule Path
Disallow

baiduspider

Rule Path
Disallow

yandex

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

*

Rule Path
Disallow
Back to top

Comments

  • Allow major search engines to crawl the site
  • Block known bad bots / scrapers
Back to top