onsrud.com
robots.txt

Robots Exclusion Standard data for onsrud.com

Resource Scan

Scan Details

Site Domain onsrud.com
Base Domain onsrud.com
Scan Status Ok
Last Scan2024-10-26T16:47:22+00:00
Next Scan 2024-11-25T16:47:22+00:00

Last Scan

Scanned2024-10-26T16:47:22+00:00
URL https://onsrud.com/robots.txt
Redirect https://www.onsrud.com/robots.txt
Redirect Domain www.onsrud.com
Redirect Base onsrud.com
Domain IPs 67.23.167.102
Redirect IPs 67.23.167.102
Response IP 67.23.167.102
Found Yes
Hash 40c15069dfc7e3cd076910a619c6589c915bb52b488ffe321cc66527d81030fd
SimHash 640adbc5cdc5

Groups

googlebot

Rule Path
Disallow /aspnet_client/
Disallow /httperrors/
Disallow /HTTPErrors/
Disallow /create_login_and_account.asp*
Disallow /showcart.asp*
Disallow /account.asp*
Disallow /payment.asp*
Disallow /security_logon.asp*
Disallow /email_friend_request.asp*
Disallow /add_product_to_favorites.asp*
Disallow /pc_product_detail.asp*
Disallow /all_reviews.asp*

googlebot-image

Rule Path
Disallow /aspnet_client/
Disallow /httperrors/
Disallow /HTTPErrors/
Disallow /create_login_and_account.asp*
Disallow /showcart.asp*
Disallow /account.asp*
Disallow /payment.asp*
Disallow /pc_product_detail.asp*
Disallow /security_logon.asp*
Disallow /email_friend_request.asp*
Disallow /add_product_to_favorites.asp*
Disallow /pc_product_detail.asp*
Disallow /all_reviews.asp*

bingbot

Rule Path
Disallow /aspnet_client/
Disallow /httperrors/
Disallow /HTTPErrors/
Disallow /create_login_and_account.asp*
Disallow /showcart.asp*
Disallow /account.asp*
Disallow /payment.asp*
Disallow /pc_product_detail.asp*
Disallow /security_logon.asp*
Disallow /email_friend_request.asp*
Disallow /add_product_to_favorites.asp*
Disallow /pc_product_detail.asp*
Disallow /all_reviews.asp*

Other Records

Field Value
crawl-delay 30

slurp

Rule Path
Disallow /aspnet_client/
Disallow /httperrors/
Disallow /HTTPErrors/
Disallow /create_login_and_account.asp*
Disallow /showcart.asp*
Disallow /account.asp*
Disallow /payment.asp*
Disallow /pc_product_detail.asp*
Disallow /security_logon.asp*
Disallow /email_friend_request.asp*
Disallow /add_product_to_favorites.asp*
Disallow /pc_product_detail.asp*
Disallow /all_reviews.asp*

Other Records

Field Value
crawl-delay 15

msnbot

Rule Path
Disallow /aspnet_client/
Disallow /httperrors/
Disallow /HTTPErrors/
Disallow /create_login_and_account.asp*
Disallow /showcart.asp*
Disallow /account.asp*
Disallow /payment.asp*
Disallow /pc_product_detail.asp*
Disallow /security_logon.asp*
Disallow /email_friend_request.asp*
Disallow /add_product_to_favorites.asp*
Disallow /pc_product_detail.asp*
Disallow /all_reviews.asp*

Other Records

Field Value
crawl-delay 30

duckduckbot

Rule Path
Disallow /aspnet_client/
Disallow /httperrors/
Disallow /HTTPErrors/
Disallow /create_login_and_account.asp*
Disallow /showcart.asp*
Disallow /account.asp*
Disallow /payment.asp*
Disallow /pc_product_detail.asp*
Disallow /security_logon.asp*
Disallow /email_friend_request.asp*
Disallow /add_product_to_favorites.asp*
Disallow /pc_product_detail.asp*
Disallow /all_reviews.asp*

Other Records

Field Value
crawl-delay 30

mj12bot

Rule Path
Disallow /aspnet_client/
Disallow /httperrors/
Disallow /HTTPErrors/
Disallow /create_login_and_account.asp*
Disallow /showcart.asp*
Disallow /account.asp*
Disallow /payment.asp*
Disallow /pc_product_detail.asp*
Disallow /security_logon.asp*
Disallow /email_friend_request.asp*
Disallow /add_product_to_favorites.asp*
Disallow /pc_product_detail.asp*
Disallow /all_reviews.asp*

Other Records

Field Value
crawl-delay 30

dotbot

Rule Path
Disallow /aspnet_client/
Disallow /httperrors/
Disallow /HTTPErrors/
Disallow /create_login_and_account.asp*
Disallow /showcart.asp*
Disallow /account.asp*
Disallow /payment.asp*
Disallow /pc_product_detail.asp*
Disallow /security_logon.asp*
Disallow /email_friend_request.asp*
Disallow /add_product_to_favorites.asp*
Disallow /pc_product_detail.asp*
Disallow /all_reviews.asp*

Other Records

Field Value
crawl-delay 10

sogou spider

Rule Path
Disallow /aspnet_client/
Disallow /httperrors/
Disallow /HTTPErrors/
Disallow /create_login_and_account.asp*
Disallow /showcart.asp*
Disallow /account.asp*
Disallow /payment.asp*
Disallow /pc_product_detail.asp*
Disallow /security_logon.asp*
Disallow /email_friend_request.asp*
Disallow /add_product_to_favorites.asp*
Disallow /pc_product_detail.asp*
Disallow /all_reviews.asp*

Other Records

Field Value
crawl-delay 20

sogou web

Rule Path
Disallow /aspnet_client/
Disallow /httperrors/
Disallow /HTTPErrors/
Disallow /create_login_and_account.asp*
Disallow /showcart.asp*
Disallow /account.asp*
Disallow /payment.asp*
Disallow /pc_product_detail.asp*
Disallow /security_logon.asp*
Disallow /email_friend_request.asp*
Disallow /add_product_to_favorites.asp*
Disallow /pc_product_detail.asp*
Disallow /all_reviews.asp*

Other Records

Field Value
crawl-delay 20

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

yandexpagechecker

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

exabot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Comments

  • Bots to allow indexing
  • Begin block Robots from robots.txt