mybiosource.com
robots.txt
Robots Exclusion Standard data for mybiosource.com
Resource Scan
Scan Details
Site Domain | mybiosource.com |
Base Domain | mybiosource.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-06-16T21:49:47+00:00 |
Next Scan | 2024-06-30T21:49:47+00:00 |
Last Successful Scan
Scanned | 2024-05-09T21:49:17+00:00 |
URL | https://mybiosource.com/robots.txt |
Redirect | https://www.mybiosource.com/robots.txt |
Redirect Domain | www.mybiosource.com |
Redirect Base | mybiosource.com |
Domain IPs | 172.66.41.5, 172.66.42.251, 2606:4700:3108::ac42:2905, 2606:4700:3108::ac42:2afb |
Redirect IPs | 172.66.41.5, 172.66.42.251, 2606:4700:3108::ac42:2905, 2606:4700:3108::ac42:2afb |
Response IP | 172.66.41.5 |
Found | Yes |
Hash | e434b345101ecc838135eab83fe7b2782b15fb0e1d82e59bf58194ae40439fc3 |
SimHash | a91d34458b7a |
Groups
*
Rule | Path |
---|---|
Disallow | /*account.php |
Disallow | /*account_edit.php |
Disallow | /*account_history.php |
Disallow | /*account_history_info.php |
Disallow | /*account_newsletters.php |
Disallow | /*account_notifications.php |
Disallow | /*account_password.php |
Disallow | /*address_book.php |
Disallow | /*address_book_process.php |
Disallow | /*advanced_search.php |
Disallow | /*checkout_confirmation.php |
Disallow | /*checkout_payment.php |
Disallow | /*checkout_payment_address.php |
Disallow | /*checkout_process.php |
Disallow | /*checkout_shipping.php |
Disallow | /*checkout_shipping_address.php |
Disallow | /*checkout_success.php |
Disallow | /*cookie_usage.php |
Disallow | /*create_account.php |
Disallow | /*create_account_success.php |
Disallow | /*download.php |
Disallow | /*info_shopping_cart.php |
Disallow | /*logoff.php |
Disallow | /*mbs_cat.php |
Disallow | /*mbs_quote.php |
Disallow | /*password_forgotten.php |
Disallow | /*shipping.php |
Disallow | /*shopping_cart.php |
Disallow | /*ssl_check.php |
Disallow | /*tell_a_friend_orig.php |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://www.mybiosource.com/sitemap.xml |
Comments