landsbankinn.is
robots.txt

Robots Exclusion Standard data for landsbankinn.is

Resource Scan

Scan Details

Site Domain landsbankinn.is
Base Domain landsbankinn.is
Scan Status Ok
Last Scan2024-09-10T15:13:29+00:00
Next Scan 2024-10-10T15:13:29+00:00

Last Scan

Scanned2024-09-10T15:13:29+00:00
URL https://landsbankinn.is/robots.txt
Redirect https://www.landsbankinn.is/robots.txt
Redirect Domain www.landsbankinn.is
Redirect Base landsbankinn.is
Domain IPs 89.104.145.151
Redirect IPs 89.104.148.153
Response IP 89.104.148.153
Found Yes
Hash 4e13597455d89bba3c955b86206d7c57b4812b8466f9e53188a7cbd4be6295de
SimHash 9a04c81c47d1

Groups

*

Rule Path
Allow /
Disallow /frettir/200*
Disallow /frettir/2010/
Disallow /frettir/2011/
Disallow /frettir/*/Hagsja*
Disallow /fjolmidlar/frettirogutgafuefni/
Disallow /einstaklingar/vildarthjonusta/
Disallow /um-bankann/stjornarhaettir/
Disallow /umlandsbankann/frettirogutgafuefni/
Disallow /frettir/*/?newsarchive

msnbot

Rule Path
Allow

Other Records

Field Value
crawl-delay 120

omniexplorer_bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.landsbankinn.is/sitemap.xml

Comments

  • slow down the msnbot