rushmarket.com
robots.txt
Robots Exclusion Standard data for rushmarket.com
Resource Scan
Scan Details
Site Domain | rushmarket.com |
Base Domain | rushmarket.com |
Scan Status | Ok |
Last Scan | 2024-10-17T14:26:06+00:00 |
Next Scan | 2024-11-16T14:26:06+00:00 |
Last Scan
Scanned | 2024-10-17T14:26:06+00:00 |
URL | https://rushmarket.com/robots.txt |
Redirect | https://www.rushmarket.com/robots.txt |
Redirect Domain | www.rushmarket.com |
Redirect Base | rushmarket.com |
Domain IPs | 75.2.60.5 |
Redirect IPs | 13.215.144.61, 13.228.199.255, 2406:da18:880:3800::c8, 2406:da18:b3d:e200::64 |
Response IP | 52.74.166.77 |
Found | Yes |
Hash | 2dcd1e51311072f8520a3e106a92828fe77da746171c926aa2b83c57ed843c11 |
SimHash | 41045c525537 |
Groups
*
Rule | Path |
---|---|
Disallow | /account/ |
*
Rule | Path |
---|---|
Allow | /account/login |
Allow | /account/register |
Allow | /account/forgotpassword |
Disallow | /admin |
Disallow | /checkout |
Disallow | /collections/ |
Disallow | /curbside-pickup |
Disallow | /pages/pickup-return |
Disallow | /pages/get-the-rush-online |
Disallow | /pages/lakeside-hours |
Disallow | /password |
Disallow | /ping |
Disallow | /preview/ |
Disallow | /products/ |
Disallow | /resource |
Other Records
Field | Value |
---|---|
sitemap | https://www.rushmarket.com/sitemap.xml |