bilbasen.dk
robots.txt
Robots Exclusion Standard data for bilbasen.dk
Resource Scan
Scan Details
| Site Domain | bilbasen.dk |
| Base Domain | bilbasen.dk |
| Scan Status | Ok |
| Last Scan | 2024-05-08T05:09:59+00:00 |
| Next Scan | 2024-05-15T05:09:59+00:00 |
Last Scan
| Scanned | 2024-05-08T05:09:59+00:00 |
| URL | https://bilbasen.dk/robots.txt |
| Redirect | https://www.bilbasen.dk/robots.txt |
| Redirect Domain | www.bilbasen.dk |
| Redirect Base | bilbasen.dk |
| Domain IPs | 65.9.112.106, 65.9.112.21, 65.9.112.37, 65.9.112.44 |
| Redirect IPs | 13.224.14.104, 13.224.14.115, 13.224.14.116, 13.224.14.43 |
| Response IP | 3.160.246.80 |
| Found | Yes |
| Hash | 87439015ce6d0b612673e15d602efa175da98a65b26d035bc122798eed689d6f |
| SimHash | 2d035a5177bb |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /LandingPages/ | - |
| Disallow | /PdfFiles/ | - |
| Disallow | /PDFFiles/ | - |
| Disallow | /Webservices/ | - |
| Disallow | /CampaignRedirect.aspx | - |
| Disallow | /campaignredirect.aspx | - |
| Disallow | /Campaign/Redirect/ | - |
| Disallow | /campaign/redirect/ | - |
| Disallow | /IfLandingpage/ | - |
| Disallow | /partnersites/ | - |
| Disallow | /Modules/If/InsuranceFormRedirect.aspx | - |
| Disallow | /user/mails | - |
| Disallow | /accept | - |
| Disallow | /brugt/bil*ZipCode%3D0000*SortBy%3Ddistance | - |
| Disallow | /18031432 | DFP adunit path - not real urls |
| Disallow | /finans/finansieringstilbud/ | - |
| Disallow | /Paging/GetUserReviewsOfCar/ | - |
| Disallow | /forum/search/0/0/ | - |
| Disallow | /print/ | - |
| Disallow | /Action/Map/* | - |
| Disallow | /pdffiles/ | - |
| Disallow | /api/ | - |
| Disallow | /*?free=* | - |
| Disallow | /newsrp | - |
| Allow | *page%3D* | - |
| Disallow | *?* | - |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bilbasen.dk/sitemap_index.axd |