take2.co.za
robots.txt

Robots Exclusion Standard data for take2.co.za

Resource Scan

Scan Details

Site Domain take2.co.za
Base Domain take2.co.za
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-02T11:30:26+00:00
Next Scan 2025-12-01T11:30:26+00:00

Last Successful Scan

Scanned2025-01-13T10:58:34+00:00
URL http://take2.co.za/robots.txt
Redirect https://www.takealot.com/robots.txt
Redirect Domain www.takealot.com
Redirect Base takealot.com
Domain IPs 34.77.94.112
Redirect IPs 104.16.71.64, 104.16.72.64, 2606:4700::6810:4740, 2606:4700::6810:4840
Response IP 104.16.72.64
Found Yes
Hash ae11b4ee5ec1b57bb2971e101c28856927233d78cacb65abdadbec7673864ba6
SimHash 0231ea63d250

Groups

*

Rule Path
Disallow /*gclid%3D
Disallow /ajax/*.php
Disallow /ajax/*.php*
Disallow /help/page/
Disallow /help/faq/*
Disallow /account/*
Disallow /*qsearch%3D
Disallow /*custom%3D
Disallow /*dcat%3D
Disallow /*sort%3DReleaseDate
Disallow /*sort%3DPrice
Disallow /*sort%3DRating
Disallow /*filter%3DPrice
Disallow /*filter%3DRating
Disallow /*filter%3DAvailability
Disallow /*filter%3DShipping
Disallow /*filter%3DBinding
Disallow /*filter%3DPromotions
Disallow /*filter%3DColour
Disallow /*filter%3DCourseCode
Disallow /*filter%3DFormat
Disallow /*filter%3DManufacturer
Disallow /*filter%3DLens
Disallow /*filter%3DASScreenSize
Disallow /*filter%3DASTabletDisplaySizes
Disallow /*filter%3DSize
Disallow /*filter%3DBabyAgeSize
Disallow /*filter%3DAlphaClothingSize
Disallow /*filter%3DAgeSize
Disallow /*filter%3DASNappySize
Disallow /*filter%3DAgeGroup
Disallow /*filter%3DAges
Disallow /*filter%3DBraSize
Disallow /*filter%3DTVScreenSize
Disallow /*filter%3DShoeSize
Disallow /*filter%3DFashionSize
Disallow /*filter%3DASRamSize
Disallow /*filter%3DLegwearSize
Disallow /*filter%3DLinenSize
Disallow /*filter%3DPaperSize
Disallow /*filter%3DStationarySize
Disallow /*filter%3DASStorageCapacity
Disallow /*filter%3DEbooksFormat
Disallow /*filter%3DASColours
Disallow /*filter%3DColourVariant
Disallow /*filter%3DBasicColours
Disallow /*filter%3DBooksFormat
Disallow /*filter%3DASCondition
Disallow /*filter%3DASDigitalAppliance
Disallow /*rows%3D
Allow /

adsbot-google
googlebot-image
mediapartners-google

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.takealot.com/sitemap.xml