mobler1.dk
robots.txt
Robots Exclusion Standard data for mobler1.dk
Resource Scan
Scan Details
| Site Domain | mobler1.dk |
| Base Domain | mobler1.dk |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2026-01-28T17:17:58+00:00 |
| Next Scan | 2026-03-29T17:17:58+00:00 |
Last Successful Scan
| Scanned | 2025-10-05T09:02:42+00:00 |
| URL | https://mobler1.dk/robots.txt |
| Redirect | https://www.mobler1.dk/robots.txt |
| Redirect Domain | www.mobler1.dk |
| Redirect Base | mobler1.dk |
| Domain IPs | 104.21.56.110, 172.67.184.166, 2606:4700:3036::ac43:b8a6, 2606:4700:3037::6815:386e |
| Redirect IPs | 104.21.56.110, 172.67.184.166, 2606:4700:3036::ac43:b8a6, 2606:4700:3037::6815:386e |
| Response IP | 172.67.184.166 |
| Found | Yes |
| Hash | ea9cfdf7e5371d86bd391664e4f7f17435c6c291828848789d10c38fbd8cb006 |
| SimHash | 5d54cc69e653 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /app/ |
| Disallow | /store_closed.html |
| Disallow | /images/companies/1/visual_search_lazy_thumb.jpg |
| Disallow | /*items_per_page* |
| Disallow | /*sort_by* |
| Disallow | /*sort_order* |
| Disallow | /*full_render* |
| Disallow | /*features_hash* |
| Disallow | /*prev_url* |
| Disallow | /*dispatch* |
| Disallow | /*show_not_found_notification* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |