babyshopstores.com
robots.txt
Robots Exclusion Standard data for babyshopstores.com
Resource Scan
Scan Details
| Site Domain | babyshopstores.com |
| Base Domain | babyshopstores.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-10T12:58:37+00:00 |
| Next Scan | 2024-09-24T12:58:37+00:00 |
Last Successful Scan
| Scanned | 2024-05-13T11:38:34+00:00 |
| URL | https://babyshopstores.com/robots.txt |
| Redirect | https://www.babyshopstores.com/robots.txt |
| Redirect Domain | www.babyshopstores.com |
| Redirect Base | babyshopstores.com |
| Domain IPs | 104.16.159.20, 104.16.160.20, 2606:4700::6810:9f14, 2606:4700::6810:a014 |
| Redirect IPs | 104.16.159.20, 104.16.160.20, 2606:4700::6810:9f14, 2606:4700::6810:a014 |
| Response IP | 104.16.159.20 |
| Found | Yes |
| Hash | 1890d3044090ba731b7d4972f1a4d30c504cf491f4894982ce574c6be48e28e4 |
| SimHash | 95687b88ccf3 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
*
| Rule | Path |
|---|---|
| Disallow | /*cart |
| Disallow | /*checkout |
| Disallow | /*my-account |
| Disallow | /*fastpay |
| Disallow | /*checkout/ |
| Disallow | /*uat1* |
| Disallow | /*?country |
| Disallow | /*preBasket |
| Disallow | /*%26discount%3D |
| Disallow | /*%26sizeRank |
| Disallow | /*%26price%3D |
| Disallow | /*%26range%3D |
| Disallow | /*manufacturerName |
| Disallow | /*search |
| Disallow | /*branchify? |
| Disallow | /*login |
| Disallow | /*register |
| Disallow | /*helpae |
| Disallow | /*helpsa |
| Disallow | /*helpbh |
| Disallow | /*helpkw |
| Disallow | /*helpom |
| Disallow | /*helpeg |
| Disallow | /*helpqa |
*
| Rule | Path |
|---|---|
| Disallow | /*?p= |
| Disallow | /*?q= |
| Disallow | /*?pl= |
| Disallow | /*?request |
| Allow | * |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.babyshopstores.com/ae/ar/sitemapindex.xml |
| sitemap | https://www.babyshopstores.com/ae/en/sitemapindex.xml |
| sitemap | https://www.babyshopstores.com/sa/ar/sitemapindex.xml |
| sitemap | https://www.babyshopstores.com/sa/en/sitemapindex.xml |
| sitemap | https://www.babyshopstores.com/qa/ar/sitemapindex.xml |
| sitemap | https://www.babyshopstores.com/qa/en/sitemapindex.xml |
| sitemap | https://www.babyshopstores.com/kw/ar/sitemapindex.xml |
| sitemap | https://www.babyshopstores.com/kw/en/sitemapindex.xml |
Warnings
- `host` is not a known field.
Comments