minthus.be
robots.txt
Robots Exclusion Standard data for minthus.be
Resource Scan
Scan Details
Site Domain | minthus.be |
Base Domain | minthus.be |
Scan Status | Ok |
Last Scan | 2024-11-08T16:38:53+00:00 |
Next Scan | 2024-11-22T16:38:53+00:00 |
Last Scan
Scanned | 2024-11-08T16:38:53+00:00 |
URL | https://minthus.be/robots.txt |
Redirect | https://www.minthus.be/robots.txt |
Redirect Domain | www.minthus.be |
Redirect Base | minthus.be |
Domain IPs | 185.104.28.118, 2a06:2ec0:1::5 |
Redirect IPs | 185.104.28.118, 2a06:2ec0:1::5 |
Response IP | 185.104.28.118 |
Found | Yes |
Hash | b048694bc774830d7037035b0e6ec14aa5f58f9706c10f5368289b805e2cae75 |
SimHash | 2632576749f5 |
Groups
yandex
yandexbot
petalbot
mj12bot
baiduspider
baiduspider-image
baiduspider-news
baiduspider-favo
baiduspider-ads
baiduspider-cpro
ru_bot
yisouspider
seznambot
Rule | Path |
---|---|
Disallow | / |
applebot
googlebot
googlebot-image
googlebot-news
mediapartners-google
adsbot-google
bingbot
bingbot
bingbot
msnbot
microsoft url control
microsoft url control - 5.01.4511
microsoft url control - 6.00.8169
msiecrawler
Rule | Path |
---|---|
Allow | / |
*
Rule | Path |
---|---|
Allow | / |
Allow | /afb/ |
Allow | /assets/ |
Allow | /assets/js/vendor/modernizr-3.7.1.min.js |
Allow | /assets/js/vendor/jquery-3.4.1.min.js |
Allow | /assets/css/style.css |
Allow | /assets/css/plugins.css |
Allow | /assets/css/iconfont.min.css |
Allow | /assets/css/helper.css |
Disallow | /admin.php |
Disallow | /.vscode/sftp.json |
Disallow | /about.php |
Disallow | /backup/ |
Disallow | /bk/ |
Disallow | /bc/ |
Disallow | /cgi-bin/ |
Disallow | /login.php |
Disallow | /123.php |
Disallow | /2019/wp-includes/wlwmanifest.xml |
Disallow | /2020/wp-includes/wlwmanifest.xml |
Disallow | /2021/wp-includes/wlwmanifest.xml |
Disallow | /administrator/index.php |
Disallow | /arif/Telerik.Web.UI.WebResource.axd |
Disallow | /Telerik.Web.UI.WebResource.axd |
Disallow | /blog/wp-includes/wlwmanifest.xml |
Disallow | /cms/wp-includes/wlwmanifest.xml |
Disallow | /data/admin/allowurl.txt |
Disallow | /e/data/js/ajax.js |
Disallow | /main/ |
Disallow | /misc/ajax.js |
Disallow | /new/ |
Disallow | /nf_tracking.php |
Disallow | /news/wp-includes/wlwmanifest.xml |
Disallow | /old/ |
Disallow | /sftp-config.json |
Disallow | /shop/wp-includes/wlwmanifest.xml |
Disallow | /site/wp-includes/wlwmanifest.xml |
Disallow | /test/wp-includes/wlwmanifest.xml |
Disallow | /tv/ |
Disallow | /web/wp-includes/wlwmanifest.xml |
Disallow | /website/wp-includes/wlwmanifest.xml |
Disallow | /wordpress/wp-includes/wlwmanifest.xml |
Disallow | /wordpress/ |
Disallow | /wp/ |
Disallow | /wp1/wp-includes/wlwmanifest.xml |
Disallow | /wp2/wp-includes/wlwmanifest.xml |
Disallow | /wp/wp-includes/wlwmanifest.xml |
Disallow | /wp-admin/css/ |
Disallow | /wp-content/ |
Disallow | /wp-content/themes/seotheme/db.php |
Disallow | /wp-includes/wlwmanifest.xml |
Disallow | /wp-story.php |
Disallow | /wp-setups.php |
Disallow | /xmlrpc.php |
Other Records
Field | Value |
---|---|
sitemap | https://www.minthus.be/sitemap.xml |
Comments