mybiosource.com
robots.txt

Robots Exclusion Standard data for mybiosource.com

Resource Scan

Scan Details

Site Domain mybiosource.com
Base Domain mybiosource.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-16T21:49:47+00:00
Next Scan 2024-06-30T21:49:47+00:00

Last Successful Scan

Scanned2024-05-09T21:49:17+00:00
URL https://mybiosource.com/robots.txt
Redirect https://www.mybiosource.com/robots.txt
Redirect Domain www.mybiosource.com
Redirect Base mybiosource.com
Domain IPs 172.66.41.5, 172.66.42.251, 2606:4700:3108::ac42:2905, 2606:4700:3108::ac42:2afb
Redirect IPs 172.66.41.5, 172.66.42.251, 2606:4700:3108::ac42:2905, 2606:4700:3108::ac42:2afb
Response IP 172.66.41.5
Found Yes
Hash e434b345101ecc838135eab83fe7b2782b15fb0e1d82e59bf58194ae40439fc3
SimHash a91d34458b7a

Groups

*

Rule Path
Disallow /*account.php
Disallow /*account_edit.php
Disallow /*account_history.php
Disallow /*account_history_info.php
Disallow /*account_newsletters.php
Disallow /*account_notifications.php
Disallow /*account_password.php
Disallow /*address_book.php
Disallow /*address_book_process.php
Disallow /*advanced_search.php
Disallow /*checkout_confirmation.php
Disallow /*checkout_payment.php
Disallow /*checkout_payment_address.php
Disallow /*checkout_process.php
Disallow /*checkout_shipping.php
Disallow /*checkout_shipping_address.php
Disallow /*checkout_success.php
Disallow /*cookie_usage.php
Disallow /*create_account.php
Disallow /*create_account_success.php
Disallow /*download.php
Disallow /*info_shopping_cart.php
Disallow /*logoff.php
Disallow /*mbs_cat.php
Disallow /*mbs_quote.php
Disallow /*password_forgotten.php
Disallow /*shipping.php
Disallow /*shopping_cart.php
Disallow /*ssl_check.php
Disallow /*tell_a_friend_orig.php

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.mybiosource.com/sitemap.xml

Comments

  • Sitemap files