member.artistguide.nl
robots.txt
Robots Exclusion Standard data for member.artistguide.nl
Resource Scan
Scan Details
Site Domain | member.artistguide.nl |
Base Domain | artistguide.nl |
Scan Status | Ok |
Last Scan | 2024-11-03T03:23:34+00:00 |
Next Scan | 2024-11-10T03:23:34+00:00 |
Last Scan
Scanned | 2024-11-03T03:23:34+00:00 |
URL | https://member.artistguide.nl/robots.txt |
Domain IPs | 136.144.160.96 |
Response IP | 136.144.160.96 |
Found | Yes |
Hash | 5c8b080f297acc6cad213073aef615baf101434ea7f3367745fc24a7549067d7 |
SimHash | 563024c0f9b1 |
Groups
*
Rule | Path |
---|---|
Disallow | /v2/ |
Disallow | /ar.p/ |
Disallow | /ajax/ |
Disallow | /purchase.p* |
Disallow | /profielinfo.p* |
Disallow | /profielfotoboek.p* |
Disallow | /profielenoverzicht.p* |
Disallow | /bannerredirect.p* |
Disallow | /partytoevoegen.p* |
aggregator:spinn3r
ahrefsbot
amazonbot
berlin-fu-cow
blexbot
ccbot
cirkwi-search/1.0
contextad bot 1.0
dataforseobot
dataprovider
deusu
dotbot
genai
genieo
grapeshot
gptbot
ia_archiver
imagesiftbot
jobdiggerspider
ltx71 - (http://ltx71.com/)
magpie-crawler
meta-externalagent
mj12bot
mormor
nerdbynature.bot
nutch
owler
petalbot
pinterest
piplbot
plukkie
proximic
qwantify
riddler
ryzecrawler
screaming frog seo spider
searchmetricsbot
seekport crawler
seekportbot
semrushbot
seokicks-robot
sistrix
siteexplorer
spbot
spinn3r
teezirfocusedcrawler
turnitinbot
vagabondo
velenpublicwebcrawler
wbsearchbot
wikido
yandex
zoominfobot
Rule | Path |
---|---|
Disallow | / |
Warnings
- 1 invalid line.
Comments