rebel.com
robots.txt
Robots Exclusion Standard data for rebel.com
Resource Scan
Scan Details
| Site Domain | rebel.com |
| Base Domain | rebel.com |
| Scan Status | Ok |
| Last Scan | 2024-05-21T14:57:48+00:00 |
| Next Scan | 2024-06-20T14:57:48+00:00 |
Last Scan
| Scanned | 2024-05-21T14:57:48+00:00 |
| URL | https://rebel.com/robots.txt |
| Redirect | https://www.rebel.com/robots.txt |
| Redirect Domain | www.rebel.com |
| Redirect Base | rebel.com |
| Domain IPs | 18.155.68.42, 18.155.68.58, 18.155.68.70, 18.155.68.88 |
| Redirect IPs | 18.155.68.42, 18.155.68.58, 18.155.68.70, 18.155.68.88 |
| Response IP | 18.155.68.58 |
| Found | Yes |
| Hash | a7256ab98666ae6222cb40c1d278eec26ea3db3733f90829085e225e5be81185 |
| SimHash | 2b59160acf93 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | *.axd |
*
| Rule | Path |
|---|---|
| Disallow | /*?* |
*
| Rule | Path |
|---|---|
| Disallow | /myaccount/ |
| Disallow | /customize/ |
| Disallow | /order/ |
| Disallow | /MyAccount/ShoppingCart.aspx |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.rebel.com/sitemap.xml |