etlehti.fi
robots.txt

Robots Exclusion Standard data for etlehti.fi

Resource Scan

Scan Details

Site Domain etlehti.fi
Base Domain etlehti.fi
Scan Status Ok
Last Scan2024-05-29T20:29:11+00:00
Next Scan 2024-06-05T20:29:11+00:00

Last Scan

Scanned2024-05-29T20:29:11+00:00
URL https://etlehti.fi/robots.txt
Redirect https://www.etlehti.fi/robots.txt
Redirect Domain www.etlehti.fi
Redirect Base etlehti.fi
Domain IPs 18.161.6.57, 18.161.6.73, 18.161.6.79, 18.161.6.86
Redirect IPs 65.9.112.123, 65.9.112.21, 65.9.112.22, 65.9.112.60
Response IP 18.165.171.36
Found Yes
Hash 9d8871b4b2277f41fc6d84def4794680b7cc65d430bb90a2993c80370347ae51
SimHash 3b4d5841a1b2

Groups

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

yandex

Rule Path
Disallow /

arquivo

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

*

Rule Path
Disallow /ly-ajax/ajah/

Other Records

Field Value
sitemap https://www.etlehti.fi/sitemap.xml

Comments

  • robots.txt
  • Directories
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)
  • Extras