m.dartworld.de
robots.txt
Robots Exclusion Standard data for m.dartworld.de
Resource Scan
Scan Details
Site Domain | m.dartworld.de |
Base Domain | dartworld.de |
Scan Status | Ok |
Last Scan | 2024-06-07T21:12:28+00:00 |
Next Scan | 2024-06-21T21:12:28+00:00 |
Last Scan
Scanned | 2024-06-07T21:12:28+00:00 |
URL | https://m.dartworld.de/robots.txt |
Domain IPs | 18.172.170.29, 18.172.170.30, 18.172.170.51, 18.172.170.7 |
Response IP | 3.160.246.66 |
Found | Yes |
Hash | df2925c6eb78b2c138e5b366bc6eff4313945a745a2f4214cbc4c408793fb1ed |
SimHash | 6d39d454cf19 |
Groups
*
Rule | Path |
---|---|
Disallow | /payment_success/ |
Disallow | /checkout_success/ |
Disallow | /checkout/ |
Disallow | /img/ |
Disallow | /payment/ |
Disallow | /add_review/ |
Disallow | /reviews/ |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
Other Records
Field | Value |
---|---|
sitemap | https://m.dartworld.de/sitemap-index.xml |