trucks.nl
robots.txt

Robots Exclusion Standard data for trucks.nl

Resource Scan

Scan Details

Site Domain trucks.nl
Base Domain trucks.nl
Scan Status Ok
Last Scan2024-05-25T08:04:18+00:00
Next Scan 2024-06-01T08:04:18+00:00

Last Scan

Scanned2024-05-25T08:04:18+00:00
URL https://trucks.nl/robots.txt
Redirect https://www.trucks.nl/robots.txt
Redirect Domain www.trucks.nl
Redirect Base trucks.nl
Domain IPs 34.102.211.122
Redirect IPs 34.102.211.122
Response IP 34.102.211.122
Found Yes
Hash 3810fc69068d2b4cbb7ea8fa4fbe698eeb751e1164d01f21993a64f9598634d1
SimHash 7acfd9506c1d

Groups

*
*

Rule Path
Disallow /favorieten
Disallow /zoeken
Disallow /zoeken*
Disallow /speciaal
Disallow /speciaal*
Disallow /speciaal/
Disallow /nieuwste-advertenties
Disallow /nieuwste-advertenties*
Disallow /stats/ar
Disallow /stats/av
Disallow /TrucksWS.wso/*
Disallow /*DealerService
Disallow /*dealerService
Disallow /*TruckServices
Disallow /*truckservices
Disallow /*?*make
Disallow /*?*country
Disallow /*?*category
Disallow /*?*sub_category
Disallow /*?*axl_configuration
Disallow /*?*number_of_axles
Disallow /*?*euro_norm
Disallow /*?*condition
Disallow /*?*transmission
Disallow /*?*properties
Disallow /*?*fuel_type
Disallow /*?*equipment
Disallow /*?*product_group
Disallow /*?*container_system
Disallow /*?*cabin
Disallow /*?*construction_year_
Disallow /*?*max_weight_
Disallow /*?*price_
Disallow /*?*mileage_
Disallow /*?*operating_hours_
Disallow /*?*load_capacity_weight_
Disallow /*?*tara_weight_
Disallow /*?*_lte=*
Disallow /*?*_gte=*
Disallow /*?*euro_norm=*
Disallow /*?*power_engine
Disallow /*?*max_weight_class
Disallow /*?*cabin_type
Disallow /*?*model_small
Disallow /*?*series
Disallow /*?*tyre_type
Disallow /*?*wheel_count
Disallow /*?*mast_type
Disallow /*?*edition
Disallow /*?*lease
Disallow /*?*color

admantx

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

applebot

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

bidswitchbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

crawler_eb_germany

Rule Path
Disallow /

criteobot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

feedburner

Rule Path
Disallow /

feedly

Rule Path
Disallow /

femtosearchbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

hyscore

Rule Path
Disallow /

ias_crawler

Rule Path
Disallow /

maxpointcrawler

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

nanointeractive

Rule Path
Disallow /

neevabot

Rule Path
Disallow /

netseer

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

peer39_crawler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

pinterestbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

safednsbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

semantic-visions.com

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

sirdatabot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

tinytestbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandexmobilebot

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.trucks.nl/sitemap-nl-index.xml

Warnings

  • 2 invalid lines.