take2.co.za
robots.txt
Robots Exclusion Standard data for take2.co.za
Resource Scan
Scan Details
| Site Domain | take2.co.za |
| Base Domain | take2.co.za |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-09-02T11:30:26+00:00 |
| Next Scan | 2025-12-01T11:30:26+00:00 |
Last Successful Scan
| Scanned | 2025-01-13T10:58:34+00:00 |
| URL | http://take2.co.za/robots.txt |
| Redirect | https://www.takealot.com/robots.txt |
| Redirect Domain | www.takealot.com |
| Redirect Base | takealot.com |
| Domain IPs | 34.77.94.112 |
| Redirect IPs | 104.16.71.64, 104.16.72.64, 2606:4700::6810:4740, 2606:4700::6810:4840 |
| Response IP | 104.16.72.64 |
| Found | Yes |
| Hash | ae11b4ee5ec1b57bb2971e101c28856927233d78cacb65abdadbec7673864ba6 |
| SimHash | 0231ea63d250 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*gclid%3D |
| Disallow | /ajax/*.php |
| Disallow | /ajax/*.php* |
| Disallow | /help/page/ |
| Disallow | /help/faq/* |
| Disallow | /account/* |
| Disallow | /*qsearch%3D |
| Disallow | /*custom%3D |
| Disallow | /*dcat%3D |
| Disallow | /*sort%3DReleaseDate |
| Disallow | /*sort%3DPrice |
| Disallow | /*sort%3DRating |
| Disallow | /*filter%3DPrice |
| Disallow | /*filter%3DRating |
| Disallow | /*filter%3DAvailability |
| Disallow | /*filter%3DShipping |
| Disallow | /*filter%3DBinding |
| Disallow | /*filter%3DPromotions |
| Disallow | /*filter%3DColour |
| Disallow | /*filter%3DCourseCode |
| Disallow | /*filter%3DFormat |
| Disallow | /*filter%3DManufacturer |
| Disallow | /*filter%3DLens |
| Disallow | /*filter%3DASScreenSize |
| Disallow | /*filter%3DASTabletDisplaySizes |
| Disallow | /*filter%3DSize |
| Disallow | /*filter%3DBabyAgeSize |
| Disallow | /*filter%3DAlphaClothingSize |
| Disallow | /*filter%3DAgeSize |
| Disallow | /*filter%3DASNappySize |
| Disallow | /*filter%3DAgeGroup |
| Disallow | /*filter%3DAges |
| Disallow | /*filter%3DBraSize |
| Disallow | /*filter%3DTVScreenSize |
| Disallow | /*filter%3DShoeSize |
| Disallow | /*filter%3DFashionSize |
| Disallow | /*filter%3DASRamSize |
| Disallow | /*filter%3DLegwearSize |
| Disallow | /*filter%3DLinenSize |
| Disallow | /*filter%3DPaperSize |
| Disallow | /*filter%3DStationarySize |
| Disallow | /*filter%3DASStorageCapacity |
| Disallow | /*filter%3DEbooksFormat |
| Disallow | /*filter%3DASColours |
| Disallow | /*filter%3DColourVariant |
| Disallow | /*filter%3DBasicColours |
| Disallow | /*filter%3DBooksFormat |
| Disallow | /*filter%3DASCondition |
| Disallow | /*filter%3DASDigitalAppliance |
| Disallow | /*rows%3D |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.takealot.com/sitemap.xml |