mrdelivery.com
robots.txt
Robots Exclusion Standard data for mrdelivery.com
Resource Scan
Scan Details
Site Domain | mrdelivery.com |
Base Domain | mrdelivery.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-19T10:44:39+00:00 |
Next Scan | 2024-11-18T10:44:39+00:00 |
Last Successful Scan
Scanned | 2024-07-15T10:36:14+00:00 |
URL | https://mrdelivery.com/robots.txt |
Redirect | https://www.mrdelivery.com/robots.txt |
Redirect Domain | www.mrdelivery.com |
Redirect Base | mrdelivery.com |
Domain IPs | 18.155.68.119, 18.155.68.122, 18.155.68.80, 18.155.68.97 |
Redirect IPs | 18.161.111.32, 18.161.111.43, 18.161.111.65, 18.161.111.80 |
Response IP | 18.165.171.73 |
Found | Yes |
Hash | 733baa8246deaec27dd2f7912d8727aceee5b2f8f5e2ecda90c6714a127c8942 |
SimHash | 74150c1008da |
Groups
*
Rule | Path |
---|---|
Disallow | /menus/ |
Disallow | /include/ |
Disallow | /fellows/ |
Disallow | /*?cq=* |
Disallow | /account/ |
Disallow | /carts/ |
Disallow | /checkout/ |
Disallow | /menu/item/ |
Disallow | /menu/section/ |
Disallow | /order/ |
Disallow | /photos/ |
Disallow | /promotions/ |
Disallow | /reviews/ |
Disallow | /storefront/ |
Disallow | /store/ |
Disallow | /tips/ |
Disallow | /views/ |
Disallow | /corporate/ |
Disallow | /wp-content/ |
Disallow | /api/email/ |
Disallow | *.php |
Disallow | *.html |
Other Records
Field | Value |
---|---|
sitemap | https://www.mrdelivery.com/xml/www.mrdelivery.com/index.xml |