andysautosport.com
robots.txt
Robots Exclusion Standard data for andysautosport.com
Resource Scan
Scan Details
| Site Domain | andysautosport.com |
| Base Domain | andysautosport.com |
| Scan Status | Ok |
| Last Scan | 2024-11-11T01:14:25+00:00 |
| Next Scan | 2024-11-18T01:14:25+00:00 |
Last Scan
| Scanned | 2024-11-11T01:14:25+00:00 |
| URL | https://www.andysautosport.com/robots.txt |
| Domain IPs | 64.150.180.250 |
| Response IP | 64.150.180.250 |
| Found | Yes |
| Hash | fe5740fa9d26f33bc95763aeef8dc36fac1f3dc078bc87eb0c3e9e863ca78c37 |
| SimHash | 080d5316e7a1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cart/ |
| Disallow | /shopping/ |
| Disallow | /checkout.html |
| Disallow | /brand/ |
| Disallow | */b/ |
| Disallow | */c/ |
| Disallow | */bc/ |
| Disallow | */v/ |
| Disallow | */s/ |
| Disallow | /how_to_become_a_millionaire_in_5_years_by_trading_stocks.html |
| Disallow | /best_return_on_investment.html |
msnbot
| Rule | Path |
|---|---|
| Disallow | /cart/ |
| Disallow | /shopping/ |
| Disallow | /checkout.html |
| Disallow | /brand/ |
| Disallow | */b/ |
| Disallow | */c/ |
| Disallow | */bc/ |
| Disallow | */v/ |
| Disallow | */s/ |
| Disallow | /how_to_become_a_millionaire_in_5_years_by_trading_stocks.html |
| Disallow | /best_return_on_investment.html |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 7 |
baiduspider
baiduspider
baiduspider+
baiduspider-video
baiduspider-image
| Rule | Path |
|---|---|
| Disallow | /cart/ |
| Disallow | /shopping/ |
| Disallow | /checkout.html |
| Disallow | /brand/ |
| Disallow | */b/ |
| Disallow | */c/ |
| Disallow | */bc/ |
| Disallow | */v/ |
| Disallow | */s/ |
| Disallow | /how_to_become_a_millionaire_in_5_years_by_trading_stocks.html |
| Disallow | /best_return_on_investment.html |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 30 |
bingbot
| Rule | Path |
|---|---|
| Disallow | /cart/ |
| Disallow | /shopping/ |
| Disallow | /checkout.html |
| Disallow | /brand/ |
| Disallow | */b/ |
| Disallow | */c/ |
| Disallow | */bc/ |
| Disallow | */v/ |
| Disallow | */s/ |
| Disallow | /how_to_become_a_millionaire_in_5_years_by_trading_stocks.html |
| Disallow | /best_return_on_investment.html |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 7 |
slurp
| Rule | Path |
|---|---|
| Disallow | /cart/ |
| Disallow | /shopping/ |
| Disallow | /checkout.html |
| Disallow | /brand/ |
| Disallow | */b/ |
| Disallow | */c/ |
| Disallow | */bc/ |
| Disallow | */v/ |
| Disallow | */s/ |
| Disallow | /how_to_become_a_millionaire_in_5_years_by_trading_stocks.html |
| Disallow | /best_return_on_investment.html |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 7 |
yahoo! slurp
| Rule | Path |
|---|---|
| Disallow | /cart/ |
| Disallow | /shopping/ |
| Disallow | /checkout.html |
| Disallow | /brand/ |
| Disallow | */b/ |
| Disallow | */c/ |
| Disallow | */bc/ |
| Disallow | */v/ |
| Disallow | */s/ |
| Disallow | /how_to_become_a_millionaire_in_5_years_by_trading_stocks.html |
| Disallow | /best_return_on_investment.html |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 7 |
yandex
| Rule | Path |
|---|---|
| Disallow | /cart/ |
| Disallow | /shopping/ |
| Disallow | /checkout.html |
| Disallow | /brand/ |
| Disallow | */b/ |
| Disallow | */c/ |
| Disallow | */bc/ |
| Disallow | */v/ |
| Disallow | */s/ |
| Disallow | /how_to_become_a_millionaire_in_5_years_by_trading_stocks.html |
| Disallow | /best_return_on_investment.html |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 30 |
ccbot
| Rule | Path |
|---|---|
| Disallow | /cart/ |
| Disallow | /shopping/ |
| Disallow | /checkout.html |
| Disallow | /brand/ |
| Disallow | */b/ |
| Disallow | */c/ |
| Disallow | */bc/ |
| Disallow | */v/ |
| Disallow | */s/ |
| Disallow | /how_to_become_a_millionaire_in_5_years_by_trading_stocks.html |
| Disallow | /best_return_on_investment.html |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 30 |
ravencrawler
| Rule | Path |
|---|---|
| Disallow | /cart/ |
| Disallow | /shopping/ |
| Disallow | /checkout.html |
| Disallow | /brand/ |
| Disallow | */b/ |
| Disallow | */c/ |
| Disallow | */bc/ |
| Disallow | */v/ |
| Disallow | */s/ |
| Disallow | /how_to_become_a_millionaire_in_5_years_by_trading_stocks.html |
| Disallow | /best_return_on_investment.html |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 7 |
semrushbot
| Rule | Path |
|---|---|
| Disallow | /cart/ |
| Disallow | /shopping/ |
| Disallow | /checkout.html |
| Disallow | /brand/ |
| Disallow | */b/ |
| Disallow | */c/ |
| Disallow | */bc/ |
| Disallow | */v/ |
| Disallow | */s/ |
| Disallow | /how_to_become_a_millionaire_in_5_years_by_trading_stocks.html |
| Disallow | /best_return_on_investment.html |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 7 |
proximic
| Rule | Path |
|---|---|
| Disallow | /cart/ |
| Disallow | /shopping/ |
| Disallow | /checkout.html |
| Disallow | /brand/ |
| Disallow | */b/ |
| Disallow | */c/ |
| Disallow | */bc/ |
| Disallow | */v/ |
| Disallow | */s/ |
| Disallow | /how_to_become_a_millionaire_in_5_years_by_trading_stocks.html |
| Disallow | /best_return_on_investment.html |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 7 |
domesticsale
| Rule | Path |
|---|---|
| Disallow | /cart/ |
| Disallow | /shopping/ |
| Disallow | /checkout.html |
| Disallow | /brand/ |
| Disallow | */b/ |
| Disallow | */c/ |
| Disallow | */bc/ |
| Disallow | */v/ |
| Disallow | */s/ |
| Disallow | /how_to_become_a_millionaire_in_5_years_by_trading_stocks.html |
| Disallow | /best_return_on_investment.html |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 7 |
zumbot
| Rule | Path |
|---|---|
| Disallow | /cart/ |
| Disallow | /shopping/ |
| Disallow | /checkout.html |
| Disallow | /brand/ |
| Disallow | */b/ |
| Disallow | */c/ |
| Disallow | */bc/ |
| Disallow | */v/ |
| Disallow | */s/ |
| Disallow | /how_to_become_a_millionaire_in_5_years_by_trading_stocks.html |
| Disallow | /best_return_on_investment.html |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 7 |
goodzer
| Rule | Path |
|---|---|
| Disallow | /cart/ |
| Disallow | /shopping/ |
| Disallow | /checkout.html |
| Disallow | /brand/ |
| Disallow | */b/ |
| Disallow | */c/ |
| Disallow | */bc/ |
| Disallow | */v/ |
| Disallow | */s/ |
| Disallow | /how_to_become_a_millionaire_in_5_years_by_trading_stocks.html |
| Disallow | /best_return_on_investment.html |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 7 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.andysautosport.com/sitemap.xml |