bdsmzaken.nl
robots.txt

Robots Exclusion Standard data for bdsmzaken.nl

Resource Scan

Scan Details

Site Domain bdsmzaken.nl
Base Domain bdsmzaken.nl
Scan Status Ok
Last Scan2024-11-11T17:02:02+00:00
Next Scan 2024-12-11T17:02:02+00:00

Last Scan

Scanned2024-11-11T17:02:02+00:00
URL https://bdsmzaken.nl/robots.txt
Domain IPs 149.210.224.188
Response IP 149.210.224.188
Found Yes
Hash ba4f36dadd3d653c7adf0948d7891144f9fa693e2d5767e6ed63479eeeb5199b
SimHash 09f309f94e42

Groups

adidxbot/2.0

Rule Path
Disallow /

adsbot-google

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-favo

Rule Path
Disallow /

baiduspider-cpro

Rule Path
Disallow /

baiduspider-ads

Rule Path
Disallow /

baidu

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

bingbot/2.0

Rule Path
Disallow /

bingpreview

Rule Path
Disallow /

bingpreview/1.0b

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

go-http-client/1.1

Rule Path
Disallow /

googleimageproxy

Rule Path
Disallow /

googlebot-image/1.0

Rule Path
Disallow /

googlebot-video/1.0

Rule Path
Disallow /

java/11.0.10

Rule Path
Disallow /

linguee

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

msnbot-media

Rule Path
Disallow /

msnbot/2.0b

Rule Path
Disallow /

petalbot
python-urllib/2.7

Rule Path
Disallow /

safari/537.36

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot/2~bl

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

symfony spider

Rule Path
Disallow /

webmastercoffee

Rule Path
Disallow /

woorank

Rule Path
Disallow /

zoominfobot+

Rule Path
Disallow /

*

Rule Path
Disallow /common/sendimage.asp
Disallow /common/myimage.asp
Disallow /content/alg-theater.asp
Disallow /content/beheer/
Disallow /content/alg-pay-ide.asp
Disallow /content/alg-pay-ide.asp?*
Disallow /content/alg-pay-ide-rep.asp
Disallow /content/alg-pay-ide-rep.asp?*
Disallow /content/alg-pay-ide-ret.asp
Disallow /content/alg-pay-ide-ret.asp?*
Disallow /content/alg-pay-mrc.asp
Disallow /content/alg-pay-mrc.asp?*
Disallow /content/alg-pay-mrc-rep.asp
Disallow /content/alg-pay-mrc-rep.asp?*
Disallow /content/alg-pay-mrc-ret.asp
Disallow /content/alg-pay-mrc-ret.asp?*
Disallow /content/alg-sitegesloten.asp
Disallow /content/bzk-tpg-frm.asp
Disallow /content/bzk-tpg-frm.asp?*
Disallow /content/dnm-chk-frm-shw.asp
Disallow /content/dnm-flm-frm.asp
Disallow /content/dnm-mng.asp
Disallow /content/dnm-sms-prv.asp
Disallow /content/dnm-sms-prv.asp?*
Disallow /content/dnm-sms-sel.asp
Disallow /content/dnm-rea-frm.asp
Disallow /content/dnm-uit-frm.asp
Disallow /content/dnm-uod-frm.asp
Disallow /content/dnm-vhl-frm.asp
Disallow /content/dnm-wnk-frm.asp
Disallow /content/dnm-wod-frm.asp
Disallow /includes/alg-crd-chg.asp

Comments

  • robots.txt for bdsmzaken en bdsmzaken-test

Warnings

  • 4 invalid lines.