m.trabantwelt.de
robots.txt

Robots Exclusion Standard data for m.trabantwelt.de

Resource Scan

Scan Details

Site Domain m.trabantwelt.de
Base Domain trabantwelt.de
Scan Status Ok
Last Scan2024-06-21T02:18:08+00:00
Next Scan 2024-07-05T02:18:08+00:00

Last Scan

Scanned2024-06-21T02:18:08+00:00
URL https://m.trabantwelt.de/robots.txt
Domain IPs 18.65.3.28, 18.65.3.50, 18.65.3.81, 18.65.3.94
Response IP 3.160.246.57
Found Yes
Hash e5c21e418c3f2a5589f37f461b464a7627378c0cb83ec202b665b25f46432ef5
SimHash 7d38dc54ef19

Groups

*

Rule Path
Disallow /payment_success/
Disallow /checkout_success/
Disallow /checkout/
Disallow /img/
Disallow /payment/
Disallow /add_review/
Disallow /reviews/

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://m.trabantwelt.de/sitemap-index.xml