tweakers.nl
robots.txt
Robots Exclusion Standard data for tweakers.nl
Resource Scan
Scan Details
Site Domain | tweakers.nl |
Base Domain | tweakers.nl |
Scan Status | Ok |
Last Scan | 2024-11-14T20:26:19+00:00 |
Next Scan | 2024-11-21T20:26:19+00:00 |
Last Scan
Scanned | 2024-11-14T20:26:19+00:00 |
URL | https://tweakers.nl/robots.txt |
Redirect | https://tweakers.net/robots.txt |
Redirect Domain | tweakers.net |
Redirect Base | tweakers.net |
Domain IPs | 2001:9a8:0:e::140, 213.239.154.20, 2a00:1188:8:31::140, 31.22.80.140 |
Redirect IPs | 2600:1413:1::1720:1d08, 2600:1413:1::6011:b431, 96.17.96.14, 96.17.96.23 |
Response IP | 104.88.70.122 |
Found | Yes |
Hash | 0ff802668a6ee5a9a86218e2815a1da0ac42bb80043ad204b3d2a5aa3fc00ed2 |
SimHash | 901481beebb3 |
Groups
*
Rule | Path |
---|---|
Disallow | /aanbod/admanager |
Disallow | /aanbod/beoordeel |
Disallow | /aanbod/bookmarks |
Disallow | /aanbod/cat/user |
Disallow | /aanbod/user |
Disallow | /aanbod/rating |
Disallow | /aanbod/edit_bod |
Disallow | /aanbod/meldpunt |
Disallow | /aanbod/reageer |
Disallow | /aanbod/placeRating |
Disallow | /aanbod/editRating |
Disallow | /aanbod/reactivateAd |
Disallow | /aanbod/deleteBid |
Disallow | /aanbod/placeBid |
Disallow | /aanbod/indebuurt |
Disallow | /aanbod/search |
Disallow | /aanbod/search_results |
Disallow | /aanbod/zoeken |
Disallow | /aanbod/nieuw |
Disallow | /aanbod/wijzigen |
Disallow | /aboshop/* |
Disallow | /abonnementen/* |
Disallow | /ajax |
Disallow | /app.php |
Disallow | /camo |
Disallow | /devicedetect |
Disallow | /ext/lt |
Disallow | /ext/pricewatch |
Disallow | /ext/reageer |
Disallow | /external |
Disallow | /gallery |
Disallow | /images |
Disallow | /instellingen |
Disallow | /my.tnet |
Disallow | /nieuws/dag |
Disallow | /notificatie |
Disallow | /pricewatch/addproduct |
Disallow | /pricewatch/clickout |
Disallow | /pricewatch/compare |
Disallow | /pricewatch/improve |
Disallow | /pricewatch/zoeken |
Disallow | /pricewatch/bestelkosten |
Disallow | /pricewatch/winkelmand_rml |
Disallow | /pricewatch/unsorted/zoeken |
Disallow | /productcollectie |
Disallow | /productreview/manager |
Disallow | /productreview/user |
Disallow | /shopreview/*/vergelijken/ |
Disallow | /shopreview/schrijven |
Disallow | /shopreview/wijzigen |
Disallow | /shopreview/reageer |
Disallow | /shopreview/wijzig-reactie |
Disallow | /reacties |
Disallow | /search |
Disallow | /shopwidget |
Disallow | /submit |
Disallow | /xmlhttp |
Disallow | /wot |
Disallow | /zoeken |
Disallow | /*?*orderSort= |
Disallow | /*?*orderField= |
Disallow | /*?*currFilters= |
Disallow | /*?*niv= |
Disallow | /*?*mode= |
Disallow | /*?*sort= |
Disallow | /*?*orderSpecId= |
Disallow | /*?*layoutMode= |
Other Records
Field | Value |
---|---|
sitemap | https://tweakers.net/nieuws/news.xml |
sitemap | https://tweakers.net/nieuws/sitemap.xml |
sitemap | https://tweakers.net/plan/sitemap.xml |
sitemap | https://tweakers.net/downloads/sitemap.xml |
sitemap | https://tweakers.net/reviews/sitemap.xml |
sitemap | https://tweakers.net/categories/sitemap.xml |
sitemap | https://tweakers.net/video/sitemap.xml |
sitemap | https://tweakers.net/pricewatch/sitemap.xml |
sitemap | https://tweakers.net/product/sitemap.xml |
sitemap | https://tweakers.net/productimage/sitemap.xml |
sitemap | https://tweakers.net/productreview/sitemap.xml |
sitemap | https://tweakers.net/carriere/sitemap.xml |
sitemap | https://tweakers.net/evergreen/group/sitemap.xml |