dtc-lease.nl
robots.txt

Robots Exclusion Standard data for dtc-lease.nl

Resource Scan

Scan Details

Site Domain dtc-lease.nl
Base Domain dtc-lease.nl
Scan Status Ok
Last Scan2024-10-19T08:56:06+00:00
Next Scan 2024-11-18T08:56:06+00:00

Last Scan

Scanned2024-10-19T08:56:06+00:00
URL https://dtc-lease.nl/robots.txt
Redirect https://www.dtc-lease.nl/robots.txt
Redirect Domain www.dtc-lease.nl
Redirect Base dtc-lease.nl
Domain IPs 76.76.21.21
Redirect IPs 76.76.21.93, 76.76.21.98
Response IP 76.76.21.61
Found Yes
Hash e989d7aac234c795f8a3086243d7b9d75664405278ec2df6b980288c03a2da0b
SimHash 4258092e67b0

Groups

*

Rule Path
Allow /

*

Rule Path
Disallow *?filter*
Disallow *?partner_tool_id*
Disallow *?supplier_id*
Disallow *?api_token*
Disallow *?results_per_page*
Disallow *?queryID*
Disallow */calculate/*
Disallow /aanvraag/thank-you
Disallow /debug*
Disallow /redirect-product/*

Other Records

Field Value
sitemap https://www.dtc-lease.nl/sitemap.xml

Comments

  • Allow all crawlers