artistguide.nl
robots.txt
Robots Exclusion Standard data for artistguide.nl
Resource Scan
Scan Details
| Site Domain | artistguide.nl |
| Base Domain | artistguide.nl |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-25T16:22:22+00:00 |
| Next Scan | 2024-10-02T16:22:22+00:00 |
Last Successful Scan
| Scanned | 2024-09-17T16:21:30+00:00 |
| URL | https://www.artistguide.nl/robots.txt |
| Domain IPs | 85.10.130.59 |
| Response IP | 85.10.130.59 |
| Found | Yes |
| Hash | 5c8b080f297acc6cad213073aef615baf101434ea7f3367745fc24a7549067d7 |
| SimHash | 563024c0f9b1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /v2/ |
| Disallow | /ar.p/ |
| Disallow | /ajax/ |
| Disallow | /purchase.p* |
| Disallow | /profielinfo.p* |
| Disallow | /profielfotoboek.p* |
| Disallow | /profielenoverzicht.p* |
| Disallow | /bannerredirect.p* |
| Disallow | /partytoevoegen.p* |
aggregator:spinn3r
ahrefsbot
amazonbot
berlin-fu-cow
blexbot
ccbot
cirkwi-search/1.0
contextad bot 1.0
dataforseobot
dataprovider
deusu
dotbot
genai
genieo
grapeshot
gptbot
ia_archiver
imagesiftbot
jobdiggerspider
ltx71 - (http://ltx71.com/)
magpie-crawler
meta-externalagent
mj12bot
mormor
nerdbynature.bot
nutch
owler
petalbot
pinterest
piplbot
plukkie
proximic
qwantify
riddler
ryzecrawler
screaming frog seo spider
searchmetricsbot
seekport crawler
seekportbot
semrushbot
seokicks-robot
sistrix
siteexplorer
spbot
spinn3r
teezirfocusedcrawler
turnitinbot
vagabondo
velenpublicwebcrawler
wbsearchbot
wikido
yandex
zoominfobot
| Rule | Path |
|---|---|
| Disallow | / |
Warnings
- 1 invalid line.
Comments