bigbasket.com
robots.txt
Robots Exclusion Standard data for bigbasket.com
Resource Scan
Scan Details
| Site Domain | bigbasket.com |
| Base Domain | bigbasket.com |
| Scan Status | Ok |
| Last Scan | 2024-11-16T09:25:03+00:00 |
| Next Scan | 2024-11-30T09:25:03+00:00 |
Last Scan
| Scanned | 2024-11-16T09:25:03+00:00 |
| URL | https://bigbasket.com/robots.txt |
| Redirect | https://www.bigbasket.com:443/robots.txt |
| Redirect Domain | www.bigbasket.com |
| Redirect Base | bigbasket.com |
| Domain IPs | 13.232.15.47, 15.207.169.123 |
| Redirect IPs | 23.215.7.10, 23.215.7.30, 2600:1413:b000:1b::17d7:70a, 2600:1413:b000:1b::17d7:71e |
| Response IP | 23.52.40.16 |
| Found | Yes |
| Hash | 87bdaf4a347f5816eef5f317ef1fe18eaef57cd223b387056bcb66bd9a159c88 |
| SimHash | 529528d2e771 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /static/*.js |
| Allow | /static/*.css |
| Allow | /static/*.png |
| Allow | /static/*.jpg |
| Allow | /get_page_data/* |
| Allow | /custompage/* |
| Allow | /product-reviews/ |
| Allow | /*cl*?page=2$ |
| Allow | /*cl*?page=3$ |
| Allow | /*cl*?page=4$ |
| Allow | /*cl*?page=5$ |
| Allow | /*cl*?page=6$ |
| Allow | /*cl*?page=7$ |
| Allow | /*cl*?page=8$ |
| Allow | /*cl*?page=9$ |
| Allow | /*pc*?page=2$ |
| Allow | /*pc*?page=3$ |
| Allow | /*pc*?page=4$ |
| Allow | /*pc*?page=5$ |
| Allow | /*pc*?page=6$ |
| Allow | /*pc*?page=7$ |
| Allow | /*pc*?page=8$ |
| Allow | /*pc*?page=9$ |
| Allow | /*pb*?page=2$ |
| Allow | /*pb*?page=3$ |
| Allow | /*pb*?page=4$ |
| Allow | /*pb*?page=5$ |
| Allow | /*pb*?page=6$ |
| Allow | /*pb*?page=7$ |
| Allow | /*pb*?page=8$ |
| Allow | /*pb*?page=9$ |
| Disallow | /p/ |
| Disallow | /product/ |
| Disallow | /ps/ |
| Disallow | /static/ |
| Disallow | /*?page= |
| Disallow | /similar-items/ |
| Disallow | /_next/data/ |