member.artistguide.nl
robots.txt

Robots Exclusion Standard data for member.artistguide.nl

Resource Scan

Scan Details

Site Domain member.artistguide.nl
Base Domain artistguide.nl
Scan Status Ok
Last Scan2024-11-03T03:23:34+00:00
Next Scan 2024-11-10T03:23:34+00:00

Last Scan

Scanned2024-11-03T03:23:34+00:00
URL https://member.artistguide.nl/robots.txt
Domain IPs 136.144.160.96
Response IP 136.144.160.96
Found Yes
Hash 5c8b080f297acc6cad213073aef615baf101434ea7f3367745fc24a7549067d7
SimHash 563024c0f9b1

Groups

*

Rule Path
Disallow /v2/
Disallow /ar.p/
Disallow /ajax/
Disallow /purchase.p*
Disallow /profielinfo.p*
Disallow /profielfotoboek.p*
Disallow /profielenoverzicht.p*
Disallow /bannerredirect.p*
Disallow /partytoevoegen.p*

aggregator:spinn3r
ahrefsbot
amazonbot
berlin-fu-cow
blexbot
ccbot
cirkwi-search/1.0
contextad bot 1.0
dataforseobot
dataprovider
deusu
dotbot
genai
genieo
grapeshot
gptbot
ia_archiver
imagesiftbot
jobdiggerspider
ltx71 - (http://ltx71.com/)
magpie-crawler
meta-externalagent
mj12bot
mormor
nerdbynature.bot
nutch
owler
petalbot
pinterest
piplbot
plukkie
proximic
qwantify
riddler
ryzecrawler
screaming frog seo spider
searchmetricsbot
seekport crawler
seekportbot
semrushbot
seokicks-robot
sistrix
siteexplorer
spbot
spinn3r
teezirfocusedcrawler
turnitinbot
vagabondo
velenpublicwebcrawler
wbsearchbot
wikido
yandex
zoominfobot

Rule Path
Disallow /

Comments

  • /robots.txt /
  • dbserver
  • Disallow: /menu.p*
  • Disallow: /fotoboek.p*

Warnings

  • 1 invalid line.