icscards.nl
robots.txt

Robots Exclusion Standard data for icscards.nl

Resource Scan

Scan Details

Site Domain icscards.nl
Base Domain icscards.nl
Scan Status Ok
Last Scan2024-09-23T07:22:50+00:00
Next Scan 2024-10-07T07:22:50+00:00

Last Scan

Scanned2024-09-23T07:22:50+00:00
URL https://icscards.nl/robots.txt
Redirect https://www.icscards.nl/robots.txt
Redirect Domain www.icscards.nl
Redirect Base icscards.nl
Domain IPs 185.195.93.72
Redirect IPs 185.195.93.72
Response IP 185.195.93.72
Found Yes
Hash 13e936ecf2fdc8e717973ab0c7ffb319ef8679ec68954723b1667cda0bf541ec
SimHash 4a8a654abf0b

Groups

*

Rule Path
Disallow */klantenservice/correctie
Disallow */klantenservice/aanvragen/id
Disallow */aio
Disallow */mijn/
Disallow */nlic
Disallow */login
Disallow */content/documents/administration
Disallow */content/taxonomies
Disallow */content/urlrewriter
Disallow */rest/settings
Disallow */sca-login
Disallow */logout
Disallow */ics-acties
Disallow */update-customer-details
Disallow */lid
Disallow */documents
Disallow *.html$
Disallow */actualisatie
Disallow */dubbelebeveiliging
Disallow *question%3D
Disallow */TSPD
Disallow *utm_source
Disallow *utm_medium
Disallow *r36
Disallow *r38
Disallow *?_ga
Disallow *log-in
Disallow */?z

dotbot

Rule Path
Disallow /

alexibot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

xenu’s

Rule Path
Disallow /

xenu’s link sleuth 1.1c

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

nextgensearchbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

archive.org bot

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

gigablast spider

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

picscout

Rule Path
Disallow /

blexbot crawler

Rule Path
Disallow /

tineye

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

sistrix crawler

Rule Path
Disallow /

uptimerobot/2.0

Rule Path
Disallow /

ezooms robot

Rule Path
Disallow /

netestate ne crawler (+http://www.website-datenbank.de/)

Rule Path
Disallow /

wiseguys robot

Rule Path
Disallow /

turnitin robot

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

pimonster

Rule Path
Disallow /

pimonster

Rule Path
Disallow /

pi-monster

Rule Path
Disallow /

eccp/1.0 (search@eniro.com)

Rule Path
Disallow /

psbot

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

zbot

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

simplepie

Rule Path
Disallow /

wget

Rule Path
Disallow /

pixray-seeker

Rule Path
Disallow /

boardreader

Rule Path
Disallow /

quantify

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

cuam

Rule Path
Disallow /

plukkie

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.icscards.nl/sitemap.xml

Warnings

  • 2 invalid lines.