m.dartworld.de
robots.txt
Robots Exclusion Standard data for m.dartworld.de
Resource Scan
Scan Details
| Site Domain | m.dartworld.de |
| Base Domain | dartworld.de |
| Scan Status | Ok |
| Last Scan | 2024-06-21T21:12:50+00:00 |
| Next Scan | 2024-07-05T21:12:50+00:00 |
Last Scan
| Scanned | 2024-06-21T21:12:50+00:00 |
| URL | https://m.dartworld.de/robots.txt |
| Domain IPs | 18.154.144.108, 18.154.144.118, 18.154.144.55, 18.154.144.6 |
| Response IP | 3.160.246.109 |
| Found | Yes |
| Hash | df2925c6eb78b2c138e5b366bc6eff4313945a745a2f4214cbc4c408793fb1ed |
| SimHash | 6d39d454cf19 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /payment_success/ |
| Disallow | /checkout_success/ |
| Disallow | /checkout/ |
| Disallow | /img/ |
| Disallow | /payment/ |
| Disallow | /add_review/ |
| Disallow | /reviews/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://m.dartworld.de/sitemap-index.xml |