bestgetest.nl
robots.txt

Robots Exclusion Standard data for bestgetest.nl

Resource Scan

Scan Details

Site Domain bestgetest.nl
Base Domain bestgetest.nl
Scan Status Ok
Last Scan2024-11-09T01:52:38+00:00
Next Scan 2024-11-16T01:52:38+00:00

Last Scan

Scanned2024-11-09T01:52:38+00:00
URL http://bestgetest.nl/robots.txt
Redirect https://tweakers.net/robots.txt
Redirect Domain tweakers.net
Redirect Base tweakers.net
Domain IPs 2001:9a8:0:e::140, 213.239.154.20, 2a00:1188:8:31::140, 31.22.80.140
Redirect IPs 2600:1413:b000:6::17d5:2bca, 2600:1413:b000:6::17d5:2bde, 96.17.96.14, 96.17.96.23
Response IP 104.88.70.122
Found Yes
Hash 0ff802668a6ee5a9a86218e2815a1da0ac42bb80043ad204b3d2a5aa3fc00ed2
SimHash 901481beebb3

Groups

*

Rule Path
Disallow /aanbod/admanager
Disallow /aanbod/beoordeel
Disallow /aanbod/bookmarks
Disallow /aanbod/cat/user
Disallow /aanbod/user
Disallow /aanbod/rating
Disallow /aanbod/edit_bod
Disallow /aanbod/meldpunt
Disallow /aanbod/reageer
Disallow /aanbod/placeRating
Disallow /aanbod/editRating
Disallow /aanbod/reactivateAd
Disallow /aanbod/deleteBid
Disallow /aanbod/placeBid
Disallow /aanbod/indebuurt
Disallow /aanbod/search
Disallow /aanbod/search_results
Disallow /aanbod/zoeken
Disallow /aanbod/nieuw
Disallow /aanbod/wijzigen
Disallow /aboshop/*
Disallow /abonnementen/*
Disallow /ajax
Disallow /app.php
Disallow /camo
Disallow /devicedetect
Disallow /ext/lt
Disallow /ext/pricewatch
Disallow /ext/reageer
Disallow /external
Disallow /gallery
Disallow /images
Disallow /instellingen
Disallow /my.tnet
Disallow /nieuws/dag
Disallow /notificatie
Disallow /pricewatch/addproduct
Disallow /pricewatch/clickout
Disallow /pricewatch/compare
Disallow /pricewatch/improve
Disallow /pricewatch/zoeken
Disallow /pricewatch/bestelkosten
Disallow /pricewatch/winkelmand_rml
Disallow /pricewatch/unsorted/zoeken
Disallow /productcollectie
Disallow /productreview/manager
Disallow /productreview/user
Disallow /shopreview/*/vergelijken/
Disallow /shopreview/schrijven
Disallow /shopreview/wijzigen
Disallow /shopreview/reageer
Disallow /shopreview/wijzig-reactie
Disallow /reacties
Disallow /search
Disallow /shopwidget
Disallow /submit
Disallow /xmlhttp
Disallow /wot
Disallow /zoeken
Disallow /*?*orderSort=
Disallow /*?*orderField=
Disallow /*?*currFilters=
Disallow /*?*niv=
Disallow /*?*mode=
Disallow /*?*sort=
Disallow /*?*orderSpecId=
Disallow /*?*layoutMode=

googlebot-news

Rule Path
Disallow /*
Allow /$
Allow /nieuws
Allow /geek
Allow /redactieblogs
Allow /reviews
Allow /downloads
Allow /plan
Allow /feeds
Allow /g/api

mj12bot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://tweakers.net/nieuws/news.xml
sitemap https://tweakers.net/nieuws/sitemap.xml
sitemap https://tweakers.net/plan/sitemap.xml
sitemap https://tweakers.net/downloads/sitemap.xml
sitemap https://tweakers.net/reviews/sitemap.xml
sitemap https://tweakers.net/categories/sitemap.xml
sitemap https://tweakers.net/video/sitemap.xml
sitemap https://tweakers.net/pricewatch/sitemap.xml
sitemap https://tweakers.net/product/sitemap.xml
sitemap https://tweakers.net/productimage/sitemap.xml
sitemap https://tweakers.net/productreview/sitemap.xml
sitemap https://tweakers.net/carriere/sitemap.xml
sitemap https://tweakers.net/evergreen/group/sitemap.xml