trucks.nl
robots.txt
Robots Exclusion Standard data for trucks.nl
Resource Scan
Scan Details
Site Domain | trucks.nl |
Base Domain | trucks.nl |
Scan Status | Ok |
Last Scan | 2024-05-25T08:04:18+00:00 |
Next Scan | 2024-06-01T08:04:18+00:00 |
Last Scan
Scanned | 2024-05-25T08:04:18+00:00 |
URL | https://trucks.nl/robots.txt |
Redirect | https://www.trucks.nl/robots.txt |
Redirect Domain | www.trucks.nl |
Redirect Base | trucks.nl |
Domain IPs | 34.102.211.122 |
Redirect IPs | 34.102.211.122 |
Response IP | 34.102.211.122 |
Found | Yes |
Hash | 3810fc69068d2b4cbb7ea8fa4fbe698eeb751e1164d01f21993a64f9598634d1 |
SimHash | 7acfd9506c1d |
Groups
*
*
Rule | Path |
---|---|
Disallow | /favorieten |
Disallow | /zoeken |
Disallow | /zoeken* |
Disallow | /speciaal |
Disallow | /speciaal* |
Disallow | /speciaal/ |
Disallow | /nieuwste-advertenties |
Disallow | /nieuwste-advertenties* |
Disallow | /stats/ar |
Disallow | /stats/av |
Disallow | /TrucksWS.wso/* |
Disallow | /*DealerService |
Disallow | /*dealerService |
Disallow | /*TruckServices |
Disallow | /*truckservices |
Disallow | /*?*make |
Disallow | /*?*country |
Disallow | /*?*category |
Disallow | /*?*sub_category |
Disallow | /*?*axl_configuration |
Disallow | /*?*number_of_axles |
Disallow | /*?*euro_norm |
Disallow | /*?*condition |
Disallow | /*?*transmission |
Disallow | /*?*properties |
Disallow | /*?*fuel_type |
Disallow | /*?*equipment |
Disallow | /*?*product_group |
Disallow | /*?*container_system |
Disallow | /*?*cabin |
Disallow | /*?*construction_year_ |
Disallow | /*?*max_weight_ |
Disallow | /*?*price_ |
Disallow | /*?*mileage_ |
Disallow | /*?*operating_hours_ |
Disallow | /*?*load_capacity_weight_ |
Disallow | /*?*tara_weight_ |
Disallow | /*?*_lte=* |
Disallow | /*?*_gte=* |
Disallow | /*?*euro_norm=* |
Disallow | /*?*power_engine |
Disallow | /*?*max_weight_class |
Disallow | /*?*cabin_type |
Disallow | /*?*model_small |
Disallow | /*?*series |
Disallow | /*?*tyre_type |
Disallow | /*?*wheel_count |
Disallow | /*?*mast_type |
Disallow | /*?*edition |
Disallow | /*?*lease |
Disallow | /*?*color |
Other Records
Field | Value |
---|---|
sitemap | https://www.trucks.nl/sitemap-nl-index.xml |
Warnings
- 2 invalid lines.