minthus.be
robots.txt

Robots Exclusion Standard data for minthus.be

Resource Scan

Scan Details

Site Domain minthus.be
Base Domain minthus.be
Scan Status Ok
Last Scan2024-11-08T16:38:53+00:00
Next Scan 2024-11-22T16:38:53+00:00

Last Scan

Scanned2024-11-08T16:38:53+00:00
URL https://minthus.be/robots.txt
Redirect https://www.minthus.be/robots.txt
Redirect Domain www.minthus.be
Redirect Base minthus.be
Domain IPs 185.104.28.118, 2a06:2ec0:1::5
Redirect IPs 185.104.28.118, 2a06:2ec0:1::5
Response IP 185.104.28.118
Found Yes
Hash b048694bc774830d7037035b0e6ec14aa5f58f9706c10f5368289b805e2cae75
SimHash 2632576749f5

Groups

yandex
yandexbot
petalbot
mj12bot
baiduspider
baiduspider-image
baiduspider-news
baiduspider-favo
baiduspider-ads
baiduspider-cpro
ru_bot
yisouspider
seznambot

Rule Path
Disallow /

applebot
googlebot
googlebot-image
googlebot-news
mediapartners-google
adsbot-google
bingbot
bingbot
bingbot
msnbot
microsoft url control
microsoft url control - 5.01.4511
microsoft url control - 6.00.8169
msiecrawler

Rule Path
Allow /

*

Rule Path
Allow /
Allow /afb/
Allow /assets/
Allow /assets/js/vendor/modernizr-3.7.1.min.js
Allow /assets/js/vendor/jquery-3.4.1.min.js
Allow /assets/css/style.css
Allow /assets/css/plugins.css
Allow /assets/css/iconfont.min.css
Allow /assets/css/helper.css
Disallow /admin.php
Disallow /.vscode/sftp.json
Disallow /about.php
Disallow /backup/
Disallow /bk/
Disallow /bc/
Disallow /cgi-bin/
Disallow /login.php
Disallow /123.php
Disallow /2019/wp-includes/wlwmanifest.xml
Disallow /2020/wp-includes/wlwmanifest.xml
Disallow /2021/wp-includes/wlwmanifest.xml
Disallow /administrator/index.php
Disallow /arif/Telerik.Web.UI.WebResource.axd
Disallow /Telerik.Web.UI.WebResource.axd
Disallow /blog/wp-includes/wlwmanifest.xml
Disallow /cms/wp-includes/wlwmanifest.xml
Disallow /data/admin/allowurl.txt
Disallow /e/data/js/ajax.js
Disallow /main/
Disallow /misc/ajax.js
Disallow /new/
Disallow /nf_tracking.php
Disallow /news/wp-includes/wlwmanifest.xml
Disallow /old/
Disallow /sftp-config.json
Disallow /shop/wp-includes/wlwmanifest.xml
Disallow /site/wp-includes/wlwmanifest.xml
Disallow /test/wp-includes/wlwmanifest.xml
Disallow /tv/
Disallow /web/wp-includes/wlwmanifest.xml
Disallow /website/wp-includes/wlwmanifest.xml
Disallow /wordpress/wp-includes/wlwmanifest.xml
Disallow /wordpress/
Disallow /wp/
Disallow /wp1/wp-includes/wlwmanifest.xml
Disallow /wp2/wp-includes/wlwmanifest.xml
Disallow /wp/wp-includes/wlwmanifest.xml
Disallow /wp-admin/css/
Disallow /wp-content/
Disallow /wp-content/themes/seotheme/db.php
Disallow /wp-includes/wlwmanifest.xml
Disallow /wp-story.php
Disallow /wp-setups.php
Disallow /xmlrpc.php

Other Records

Field Value
sitemap https://www.minthus.be/sitemap.xml

Comments

  • verboden robots
  • SEO
  • default settings for every bot that might read and respect this file