marleyspoon.com
robots.txt
Robots Exclusion Standard data for marleyspoon.com
Resource Scan
Scan Details
Site Domain | marleyspoon.com |
Base Domain | marleyspoon.com |
Scan Status | Ok |
Last Scan | 2024-05-20T10:39:57+00:00 |
Next Scan | 2024-06-03T10:39:57+00:00 |
Last Scan
Scanned | 2024-05-20T10:39:57+00:00 |
URL | https://marleyspoon.com/robots.txt |
Domain IPs | 13.226.225.112, 13.226.225.58, 13.226.225.63, 13.226.225.67 |
Response IP | 108.157.60.23 |
Found | Yes |
Hash | 58f4163b443fbac91a0b864f7c6757f134a3cf55caa066d4cd75d208dbf8680e |
SimHash | bef52c0f51c0 |
Groups
*
Rule | Path |
---|---|
Disallow | /checkout |
Disallow | /cart |
Disallow | /orders |
Disallow | /countries |
Disallow | /line_items |
Disallow | /password_resets |
Disallow | /states |
Disallow | /user_sessions |
Disallow | /user_registrations |
Disallow | /users |
Disallow | /account |
Disallow | /datenschutz |
Disallow | /agb |
Disallow | /menu/*/card |
Disallow | /menu/*/download |
Comments