newsmonkey.be
robots.txt
Robots Exclusion Standard data for newsmonkey.be
Resource Scan
Scan Details
Site Domain | newsmonkey.be |
Base Domain | newsmonkey.be |
Scan Status | Ok |
Last Scan | 2024-06-26T20:26:34+00:00 |
Next Scan | 2024-07-03T20:26:34+00:00 |
Last Scan
Scanned | 2024-06-26T20:26:34+00:00 |
URL | https://newsmonkey.be/robots.txt |
Domain IPs | 199.232.194.132, 199.232.198.132, 2a04:4e42:4c::644, 2a04:4e42:4d::644 |
Response IP | 199.232.194.132 |
Found | Yes |
Hash | ed5202786f64cc72e8c6291a2b2fbe9d429214df33f344ede40965aea3324aa8 |
SimHash | 6f539c260e13 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | *.php |
Disallow | /newsletters/*.html |
Disallow | /wp-admin |
Disallow | /wp-admin/admin-ajax.php |
Disallow | /wp-login.php |
Disallow | /wp-sidebar.php |
Disallow | /wp-infinity.php |
Disallow | /login |
Disallow | /zoeken |
Disallow | /search |
Disallow | /Recherche |
Disallow | /?s= |
Disallow | */page/* |
Disallow | *?page=* |
Disallow | /tag/ |
Disallow | /2010/ |
Disallow | /2011/ |
Disallow | /2012/ |
Disallow | /2013/ |
Disallow | /2014/ |
Disallow | /2015/ |
Disallow | /2016/ |
Disallow | /2017/ |
Disallow | /2018/ |
Disallow | /2019/ |
Disallow | /2020/ |
Disallow | /2021/ |
Disallow | /2022/ |
Disallow | /2023/ |
Disallow | /2024/ |
Disallow | /2025/ |
Other Records
Field | Value |
---|---|
sitemap | https://newsmonkey.be/sitemap_index.xml |
sitemap | https://newsmonkey.be/sitemap-news.xml |
sitemap | https://fr.newsmonkey.be/sitemap_index.xml |
sitemap | https://fr.newsmonkey.be/sitemap-news.xml |