ordnet.dk
robots.txt
Robots Exclusion Standard data for ordnet.dk
Resource Scan
Scan Details
| Site Domain | ordnet.dk |
| Base Domain | ordnet.dk |
| Scan Status | Ok |
| Last Scan | 2024-05-02T23:23:30+00:00 |
| Next Scan | 2024-06-01T23:23:30+00:00 |
Last Scan
| Scanned | 2024-05-02T23:23:30+00:00 |
| URL | https://ordnet.dk/robots.txt |
| Domain IPs | 130.226.232.159 |
| Response IP | 130.226.232.159 |
| Found | Yes |
| Hash | e5fef60d6ea8ff62478e5fc54d3158963a38d0cf870f1021ccdfeb3b3ad828eb |
| SimHash | 45108884c694 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | / |
googlebot
| Rule | Path |
|---|---|
| Disallow | /ddo_en |
| Disallow | /ods_en |
| Disallow | /billeder |
| Disallow | /korpusdk_en |
| Disallow | /korpusdk/ |
| Disallow | /ddo/*aselect%3D |
| Disallow | /ddo/*mselect%3D |
| Disallow | /ddo/*select%3D |
| Disallow | /ddo/*%3Drel404 |
| Disallow | /ddo/*lpage%3D |
| Disallow | /ddo/*browse%3D |
| Disallow | /ddo/*first_id%3D |
| Disallow | /ddo/*last_id%3D |
| Disallow | /ddo/billeder |
| Disallow | /ods/*aselect%3D |
| Disallow | /ods/*mselect%3D |
| Disallow | /ods/*select%3D |
| Disallow | /ods/*%3Drel404 |
| Disallow | /ods/*lpage%3D |
| Disallow | /ods/*browse%3D |
| Disallow | /ods/*first_id%3D |
| Disallow | /ods/*last_id%3D |
| Disallow | /ods/*opslag?opslag= |
| Disallow | /ods/billeder |
| Disallow | /moth |
| Disallow | /meyer |
| Disallow | /ho |
| Disallow | /go |
| Disallow | /lada |
| Disallow | /ko |
| Disallow | /ldo |
| Disallow | /ren/ordbog/*select%3D |
| Disallow | /gdo/ordbog/*select%3D |
| Disallow | /dnl/ordbog/*select%3D |
bingbot
| Rule | Path |
|---|---|
| Disallow | /ddo_en |
| Disallow | /ods_en |
| Disallow | /billeder |
| Disallow | /korpusdk_en |
| Disallow | /korpusdk/ |
| Disallow | /ddo/*aselect%3D |
| Disallow | /ddo/*mselect%3D |
| Disallow | /ddo/*select%3D |
| Disallow | /ddo/*%3Drel404 |
| Disallow | /ddo/*lpage%3D |
| Disallow | /ddo/*browse%3D |
| Disallow | /ddo/*first_id%3D |
| Disallow | /ddo/*last_id%3D |
| Disallow | /ddo/billeder |
| Disallow | /ods/*aselect%3D |
| Disallow | /ods/*mselect%3D |
| Disallow | /ods/*select%3D |
| Disallow | /ods/*%3Drel404 |
| Disallow | /ods/*lpage%3D |
| Disallow | /ods/*browse%3D |
| Disallow | /ods/*first_id%3D |
| Disallow | /ods/*last_id%3D |
| Disallow | /ods/*opslag?opslag= |
| Disallow | /ods/billeder |
| Disallow | /moth |
| Disallow | /meyer |
| Disallow | /ho |
| Disallow | /go |
| Disallow | /lada |
| Disallow | /ko |
| Disallow | /sdo |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://ordnet.dk/sitemap_index.xml |
Comments