abt.com
robots.txt
Robots Exclusion Standard data for abt.com
Resource Scan
Scan Details
| Site Domain | abt.com |
| Base Domain | abt.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-22T04:14:40+00:00 |
| Next Scan | 2024-12-21T04:14:40+00:00 |
Last Successful Scan
| Scanned | 2023-05-05T19:29:54+00:00 |
| URL | https://abt.com/robots.txt |
| Domain IPs | 104.18.123.2, 104.18.124.2, 2606:4700::6812:7b02, 2606:4700::6812:7c02 |
| Response IP | 104.18.123.2 |
| Found | Yes |
| Hash | 6704827aa6d5f9cd169f64aae64b945166835cb17b2a5e9251ebfddc5366d136 |
| SimHash | a019dc64a3f3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /includes/ |
| Disallow | /mobile/order_* |
| Disallow | /mobile/cart.php* |
| Disallow | /mobile/email_friend.php* |
| Disallow | /mobile/search.php?* |
| Disallow | /mobile/search_proxy.php* |
| Disallow | /maintenance* |
| Disallow | /resources/pages/maintenance.html |
| Disallow | /resources/pages/category_print.php* |
| Disallow | /resources/pages/search_proxy.php* |
| Disallow | /resources/pages/search.php* |
| Disallow | /list/* |
| Disallow | /email/* |
| Disallow | /pay/* |
| Disallow | /resources/pages/capture_zipcode.php* |
| Disallow | /resources/pages/cart.php* |
| Disallow | /resources/pages/gift_lists.php* |
| Disallow | /resources/pages/checkout_login.php* |
| Disallow | /resources/pages/account.php* |
| Disallow | /resources/pages/shipping.php* |
| Disallow | /resources/pages/billing.php* |
| Disallow | /resources/pages/order_confirmation.php* |
| Disallow | /resources/ajax/fb.php* |
| Disallow | /resources/ajax/also_compared.php* |
| Disallow | /resources/ajax/highest_rated.php* |
| Disallow | /resources/ajax/also_bought.php* |
| Disallow | /resources/ajax/best_sellers.php* |
| Disallow | /resources/ajax/record_token_view.php* |
| Disallow | /resources/ajax/more_to_consider_brand.php* |
| Disallow | /resources/ajax/also_viewed.php* |
| Disallow | /resources/ajax/video/view* |
| Disallow | /resources/ajax/video/preset* |
| Disallow | /resources/ajax/category_widget.php* |
| Disallow | /resources/ajax/featured_brands.php* |
| Disallow | /cdn-cgi/* |
adsbot-google
| Rule | Path |
|---|---|
| Disallow | /includes/ |
| Disallow | /mobile/order_* |
| Disallow | /mobile/cart.php* |
| Disallow | /mobile/email_friend.php* |
| Disallow | /mobile/search.php?* |
| Disallow | /mobile/search_proxy.php* |
| Disallow | /maintenance* |
| Disallow | /resources/pages/maintenance.html |
| Disallow | /resources/pages/category_print.php* |
| Disallow | /resources/pages/search_proxy.php* |
| Disallow | /resources/pages/search.php* |
| Disallow | /list/* |
| Disallow | /email/* |
| Disallow | /pay/* |
| Disallow | /resources/pages/capture_zipcode.php* |
| Disallow | /resources/pages/cart.php* |
| Disallow | /resources/pages/gift_lists.php* |
| Disallow | /resources/pages/checkout_login.php* |
| Disallow | /resources/pages/account.php* |
| Disallow | /resources/pages/shipping.php* |
| Disallow | /resources/pages/billing.php* |
| Disallow | /resources/pages/order_confirmation.php* |
| Disallow | /resources/ajax/fb.php* |
| Disallow | /resources/ajax/also_compared.php* |
| Disallow | /resources/ajax/highest_rated.php* |
| Disallow | /resources/ajax/also_bought.php* |
| Disallow | /resources/ajax/best_sellers.php* |
| Disallow | /resources/ajax/record_token_view.php* |
| Disallow | /resources/ajax/more_to_consider_brand.php* |
| Disallow | /resources/ajax/also_viewed.php* |
| Disallow | /resources/ajax/video/view* |
| Disallow | /resources/ajax/video/preset* |
| Disallow | /resources/ajax/category_widget.php* |
| Disallow | /resources/ajax/featured_brands.php* |
| Disallow | /cdn-cgi/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.abt.com/sitemap.xml |
Warnings
- 2 invalid lines.