alcosales.com
robots.txt
Robots Exclusion Standard data for alcosales.com
Resource Scan
Scan Details
Site Domain | alcosales.com |
Base Domain | alcosales.com |
Scan Status | Ok |
Last Scan | 2024-09-17T10:40:12+00:00 |
Next Scan | 2024-10-17T10:40:12+00:00 |
Last Scan
Scanned | 2024-09-17T10:40:12+00:00 |
URL | https://alcosales.com/robots.txt |
Domain IPs | 67.23.168.214 |
Response IP | 67.23.168.214 |
Found | Yes |
Hash | e1c551f9e36c0731e5896c05093c832fb919fbfb86397f876488f83179866aed |
SimHash | 660a40c185db |
Groups
*
Rule | Path |
---|---|
Disallow | /%3C% |
Disallow | /%3C% |
googlebot
Rule | Path |
---|---|
Disallow | /aspnet_client/ |
Disallow | /httperrors/ |
Disallow | /HTTPErrors/ |
Disallow | /create_login_and_account.asp* |
Disallow | /showcart.asp* |
Disallow | /account.asp* |
Disallow | /payment.asp* |
Disallow | /Templates/ |
googlebot-image
Rule | Path |
---|---|
Disallow | /aspnet_client/ |
Disallow | /httperrors/ |
Disallow | /HTTPErrors/ |
Disallow | /create_login_and_account.asp* |
Disallow | /showcart.asp* |
Disallow | /account.asp* |
Disallow | /payment.asp* |
Disallow | /Templates/ |
bingbot
Rule | Path |
---|---|
Disallow | /aspnet_client/ |
Disallow | /httperrors/ |
Disallow | /HTTPErrors/ |
Disallow | /create_login_and_account.asp* |
Disallow | /showcart.asp* |
Disallow | /account.asp* |
Disallow | /payment.asp* |
Disallow | /Templates/ |
Other Records
Field | Value |
---|---|
crawl-delay | 45 |
slurp
Rule | Path |
---|---|
Disallow | /aspnet_client/ |
Disallow | /httperrors/ |
Disallow | /HTTPErrors/ |
Disallow | /create_login_and_account.asp* |
Disallow | /showcart.asp* |
Disallow | /account.asp* |
Disallow | /payment.asp* |
Disallow | /Templates/ |
Other Records
Field | Value |
---|---|
crawl-delay | 15 |
msnbot
Rule | Path |
---|---|
Disallow | /aspnet_client/ |
Disallow | /httperrors/ |
Disallow | /HTTPErrors/ |
Disallow | /create_login_and_account.asp* |
Disallow | /showcart.asp* |
Disallow | /account.asp* |
Disallow | /payment.asp* |
Disallow | /Templates/ |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |
Warnings
- 17 invalid lines.
Comments