bestnest.com
robots.txt
Robots Exclusion Standard data for bestnest.com
Resource Scan
Scan Details
| Site Domain | bestnest.com |
| Base Domain | bestnest.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-11-29T05:55:44+00:00 |
| Next Scan | 2026-01-28T05:55:44+00:00 |
Last Successful Scan
| Scanned | 2025-09-07T22:32:20+00:00 |
| URL | https://bestnest.com/robots.txt |
| Domain IPs | 104.26.14.73, 104.26.15.73, 172.67.75.176, 2606:4700:20::681a:e49, 2606:4700:20::681a:f49, 2606:4700:20::ac43:4bb0 |
| Response IP | 104.26.14.73 |
| Found | Yes |
| Hash | a916ec12a84eba34f176c4d15684904e4f4ddb7221c7d1217ade1a1f43ec2e3d |
| SimHash | 584d5a5435d2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /_private/ |
| Disallow | /bestnest/images_product/ |
| Disallow | /bestnest/images_site/ |
| Disallow | /bestnest/img_p/ |
| Disallow | /bestnest/inc/ |
| Disallow | /bestnest/js/ |
| Disallow | /bestnest/ap/ |
| Disallow | /bestnest/rtcheckout.asp |
| Disallow | /bestnest/partners/ |
| Disallow | /acme/ |
| Disallow | /ws/ |
| Disallow | /hrdocs/ |
| Disallow | /secure/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bestnest.com/sitemap_index.xml |
Comments