parkexplorer.be
robots.txt

Robots Exclusion Standard data for parkexplorer.be

Resource Scan

Scan Details

Site Domain parkexplorer.be
Base Domain parkexplorer.be
Scan Status Ok
Last Scan2024-11-18T01:57:17+00:00
Next Scan 2024-11-25T01:57:17+00:00

Last Scan

Scanned2024-11-18T01:57:17+00:00
URL https://parkexplorer.be/robots.txt
Redirect https://www.parkexplorer.be/robots.txt
Redirect Domain www.parkexplorer.be
Redirect Base parkexplorer.be
Domain IPs 104.21.51.71, 172.67.176.242, 2606:4700:3031::6815:3347, 2606:4700:3033::ac43:b0f2
Redirect IPs 104.21.51.71, 172.67.176.242, 2606:4700:3031::6815:3347, 2606:4700:3033::ac43:b0f2
Response IP 104.21.51.71
Found Yes
Hash 2f59759cc5b9beb4a60b19781ef4f7b2c0bcda340046433c42346db2b64b4100
SimHash 517f4960ee90

Groups

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

ca-crawler

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

nlux_iaharvester

Rule Path
Disallow /

adscanner

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

*

Rule Path
Disallow /Process/

Other Records

Field Value
sitemap https://www.parkexplorer.be/sitemapimages-nl.xml
sitemap https://www.parkexplorer.be/sitemapimages-fr.xml
sitemap https://www.parkexplorer.be/sitemap-nl.xml
sitemap https://www.parkexplorer.be/sitemap-fr.xml