m.dartworld.de
robots.txt

Robots Exclusion Standard data for m.dartworld.de

Resource Scan

Scan Details

Site Domain m.dartworld.de
Base Domain dartworld.de
Scan Status Ok
Last Scan2024-06-07T21:12:28+00:00
Next Scan 2024-06-21T21:12:28+00:00

Last Scan

Scanned2024-06-07T21:12:28+00:00
URL https://m.dartworld.de/robots.txt
Domain IPs 18.172.170.29, 18.172.170.30, 18.172.170.51, 18.172.170.7
Response IP 3.160.246.66
Found Yes
Hash df2925c6eb78b2c138e5b366bc6eff4313945a745a2f4214cbc4c408793fb1ed
SimHash 6d39d454cf19

Groups

*

Rule Path
Disallow /payment_success/
Disallow /checkout_success/
Disallow /checkout/
Disallow /img/
Disallow /payment/
Disallow /add_review/
Disallow /reviews/

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://m.dartworld.de/sitemap-index.xml