openbank.nl
robots.txt

Robots Exclusion Standard data for openbank.nl

Resource Scan

Scan Details

Site Domain openbank.nl
Base Domain openbank.nl
Scan Status Ok
Last Scan2024-11-16T17:58:25+00:00
Next Scan 2024-11-30T17:58:25+00:00

Last Scan

Scanned2024-11-16T17:58:25+00:00
URL https://openbank.nl/robots.txt
Redirect https://www.openbank.nl/robots.txt
Redirect Domain www.openbank.nl
Redirect Base openbank.nl
Domain IPs 3.164.85.106, 3.164.85.18, 3.164.85.21, 3.164.85.61
Redirect IPs 3.165.82.109, 3.165.82.12, 3.165.82.72, 3.165.82.90
Response IP 3.165.82.90
Found Yes
Hash 6b0facb436fb881bbc035d3d3e30ec6bffd828b01786e00fc3959d197c97d9bb
SimHash b9cb53c08f73

Groups

*

Rule Path
Disallow /es-nl/*
Disallow */csopen*
Disallow */node/*
Disallow */taxonomy/*
Disallow */assets/*.js
Disallow */assets/*.css
Disallow */assets/*.pdf
Disallow */assets/*.jpg
Disallow */assets/*.svg
Disallow */assets/*.png
Disallow */assets/*.jpeg
Disallow */assets/*.xls
Disallow */assets/*.doc
Disallow */assets/*.xlsx
Disallow */assets/*.docx
Disallow */assets/*.json
Disallow */assets/*.tar.gz
Disallow */es/*

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

fast

Rule Path
Disallow /

slurp

Rule Path
Disallow /

maxthon

Rule Path
Disallow /

cncdialer

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.openbank.nl/sitemap-nl.xml

Comments

  • robots.txt for https://www.openbank.nl