parkexplorer.nl
robots.txt

Robots Exclusion Standard data for parkexplorer.nl

Resource Scan

Scan Details

Site Domain parkexplorer.nl
Base Domain parkexplorer.nl
Scan Status Ok
Last Scan2024-11-16T05:39:52+00:00
Next Scan 2024-11-23T05:39:52+00:00

Last Scan

Scanned2024-11-16T05:39:52+00:00
URL https://parkexplorer.nl/robots.txt
Redirect https://www.parkexplorer.nl/robots.txt
Redirect Domain www.parkexplorer.nl
Redirect Base parkexplorer.nl
Domain IPs 104.21.79.227, 172.67.149.74, 2606:4700:3034::ac43:954a, 2606:4700:3036::6815:4fe3
Redirect IPs 104.21.79.227, 172.67.149.74, 2606:4700:3034::ac43:954a, 2606:4700:3036::6815:4fe3
Response IP 172.67.149.74
Found Yes
Hash 440fb630608917d258be2c3586f58fdc7f01b466b4c6b4ad8f7950aece8725e6
SimHash 5a1f4940ee10

Groups

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

ca-crawler

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

nlux_iaharvester

Rule Path
Disallow /

adscanner

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

*

Rule Path
Disallow /Process/

Other Records

Field Value
sitemap https://www.parkexplorer.nl/sitemapimages.xml
sitemap https://www.parkexplorer.nl/sitemap.xml