adopt.com
robots.txt
Robots Exclusion Standard data for adopt.com
Resource Scan
Scan Details
| Site Domain | adopt.com |
| Base Domain | adopt.com |
| Scan Status | Ok |
| Last Scan | 2025-09-08T11:41:40+00:00 |
| Next Scan | 2025-09-22T11:41:40+00:00 |
Last Scan
| Scanned | 2025-09-08T11:41:40+00:00 |
| URL | https://adopt.com/robots.txt |
| Redirect | https://www.adopt.com/robots.txt |
| Redirect Domain | www.adopt.com |
| Redirect Base | adopt.com |
| Domain IPs | 104.26.2.246, 104.26.3.246, 172.67.75.17 |
| Redirect IPs | 104.26.2.246, 104.26.3.246, 172.67.75.17 |
| Response IP | 104.26.3.246 |
| Found | Yes |
| Hash | 40fe6d87c2d54fac035f0af7f27b56c7ebd2e725ada2d37c24dbba3345ba122b |
| SimHash | 6d24d987c516 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /app/ |
| Disallow | /bin/ |
| Disallow | /dev/ |
| Disallow | /js/ |
| Disallow | /lib/ |
| Disallow | /phpserver/ |
| Disallow | /pub/ |
| Disallow | /report/ |
| Disallow | /skin/ |
| Disallow | /var/ |
| Disallow | /vendor/ |
| Disallow | /LICENSE.txt |
| Disallow | /LICENSE.html |
| Disallow | /catalog/ |
| Disallow | /catalog/product_compare/ |
| Disallow | /catalog/category/view/ |
| Disallow | /catalog/product/view/ |
| Disallow | /catalogsearch/ |
| Disallow | /checkout/* |
| Disallow | /customer/ |
| Disallow | /customer/account/* |
| Disallow | /customer/account/ |
| Disallow | /customer/account/login/ |
| Disallow | /enable-cookies/ |
| Disallow | /onestepcheckout/ |
| Disallow | /pkginfo/ |
| Disallow | /sendfriend/ |
| Disallow | /tag/ |
| Disallow | /review/ |
| Disallow | /review/product/ |
| Disallow | /sales/order/ |
| Disallow | /cat%3D* |
| Disallow | /*categorie_ |
| Disallow | /*olfactive_fam%3D |
| Disallow | /index.php/ |
| Disallow | /? |
| Disallow | /*.php$ |
| Disallow | /?SID= |
| Disallow | /?limit=all |
| Disallow | /?dir |
| Disallow | /?dir=desc |
| Disallow | /?dir=asc |
| Disallow | /?limit=all |
| Disallow | /?mode* |
| Disallow | .php$ |
| Disallow | *?SID= |
| Disallow | *?limit=all |
| Disallow | *?dir |
| Disallow | *?dir=desc |
| Disallow | *?dir=asc |
| Disallow | *?limit=all |
| Disallow | *?mode* |
| Disallow | *?* |
| Allow | /*?p= |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.adopt.com/sitemap/sitemap.xml |
| sitemap | https://www.adopt.com/fr/sitemap/sitemap.xml |
| sitemap | https://www.adopt.com/en/sitemap/sitemap.xml |
| sitemap | https://www.adopt.com/es/sitemap/sitemap.xml |
| sitemap | https://www.adopt.com/be-nl/sitemap/sitemap.xml |
| sitemap | https://www.adopt.com/be-fr/sitemap/sitemap.xml |
Warnings
- 1 invalid line.