bestgetest.nl
robots.txt
Robots Exclusion Standard data for bestgetest.nl
Resource Scan
Scan Details
| Site Domain | bestgetest.nl |
| Base Domain | bestgetest.nl |
| Scan Status | Ok |
| Last Scan | 2024-09-20T19:32:45+00:00 |
| Next Scan | 2024-09-27T19:32:45+00:00 |
Last Scan
| Scanned | 2024-09-20T19:32:45+00:00 |
| URL | http://bestgetest.nl/robots.txt |
| Redirect | https://tweakers.net/robots.txt |
| Redirect Domain | tweakers.net |
| Redirect Base | tweakers.net |
| Domain IPs | 2001:9a8:0:e::140, 213.239.154.20, 2a00:1188:8:31::140, 31.22.80.140 |
| Redirect IPs | 23.59.168.115, 2600:1413:b000:6::17d5:2bca, 2600:1413:b000:6::17d5:2bde |
| Response IP | 23.59.168.115 |
| Found | Yes |
| Hash | 542913a1cf47129902eed6c9467182d175f451faa06689aa8b6f0128f3b6d720 |
| SimHash | 9014819eebb3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /aanbod/admanager |
| Disallow | /aanbod/beoordeel |
| Disallow | /aanbod/bookmarks |
| Disallow | /aanbod/cat/user |
| Disallow | /aanbod/user |
| Disallow | /aanbod/rating |
| Disallow | /aanbod/edit_bod |
| Disallow | /aanbod/meldpunt |
| Disallow | /aanbod/reageer |
| Disallow | /aanbod/placeRating |
| Disallow | /aanbod/editRating |
| Disallow | /aanbod/reactivateAd |
| Disallow | /aanbod/deleteBid |
| Disallow | /aanbod/placeBid |
| Disallow | /aanbod/indebuurt |
| Disallow | /aanbod/search |
| Disallow | /aanbod/search_results |
| Disallow | /aanbod/zoeken |
| Disallow | /aanbod/nieuw |
| Disallow | /aanbod/wijzigen |
| Disallow | /aboshop/* |
| Disallow | /abonnementen/* |
| Disallow | /ajax |
| Disallow | /app.php |
| Disallow | /camo |
| Disallow | /devicedetect |
| Disallow | /ext/lt |
| Disallow | /ext/pricewatch |
| Disallow | /ext/reageer |
| Disallow | /external |
| Disallow | /gallery |
| Disallow | /images |
| Disallow | /instellingen |
| Disallow | /my.tnet |
| Disallow | /nieuws/dag |
| Disallow | /notificatie |
| Disallow | /pricewatch/addproduct |
| Disallow | /pricewatch/clickout |
| Disallow | /pricewatch/compare |
| Disallow | /pricewatch/improve |
| Disallow | /pricewatch/zoeken |
| Disallow | /pricewatch/bestelkosten |
| Disallow | /pricewatch/winkelmand_rml |
| Disallow | /pricewatch/unsorted/zoeken |
| Disallow | /productcollectie |
| Disallow | /productreview/manager |
| Disallow | /productreview/user |
| Disallow | /shopreview/*/vergelijken/ |
| Disallow | /shopreview/schrijven |
| Disallow | /shopreview/wijzigen |
| Disallow | /shopreview/reageer |
| Disallow | /shopreview/wijzig-reactie |
| Disallow | /reacties |
| Disallow | /search |
| Disallow | /shopwidget |
| Disallow | /submit |
| Disallow | /xmlhttp |
| Disallow | /wot |
| Disallow | /zoeken |
| Disallow | /*?*orderSort= |
| Disallow | /*?*orderField= |
| Disallow | /*?*currFilters= |
| Disallow | /*?*niv= |
| Disallow | /*?*mode= |
| Disallow | /*?*sort= |
| Disallow | /*?*orderSpecId= |
| Disallow | /*?*f= |
| Disallow | /*?*layoutMode= |
Other Records
| Field | Value |
|---|---|
| sitemap | https://tweakers.net/nieuws/news.xml |
| sitemap | https://tweakers.net/nieuws/sitemap.xml |
| sitemap | https://tweakers.net/plan/sitemap.xml |
| sitemap | https://tweakers.net/downloads/sitemap.xml |
| sitemap | https://tweakers.net/reviews/sitemap.xml |
| sitemap | https://tweakers.net/categories/sitemap.xml |
| sitemap | https://tweakers.net/video/sitemap.xml |
| sitemap | https://tweakers.net/pricewatch/sitemap.xml |
| sitemap | https://tweakers.net/product/sitemap.xml |
| sitemap | https://tweakers.net/productimage/sitemap.xml |
| sitemap | https://tweakers.net/productreview/sitemap.xml |
| sitemap | https://tweakers.net/carriere/sitemap.xml |
| sitemap | https://tweakers.net/evergreen/group/sitemap.xml |