cylex.net.za
robots.txt

Robots Exclusion Standard data for cylex.net.za

Resource Scan

Scan Details

Site Domain cylex.net.za
Base Domain cylex.net.za
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-05T14:37:18+00:00
Next Scan 2026-04-05T14:37:18+00:00

Last Successful Scan

Scanned2025-08-16T01:29:08+00:00
URL https://cylex.net.za/robots.txt
Redirect https://www.cylex.net.za/robots.txt
Redirect Domain www.cylex.net.za
Redirect Base cylex.net.za
Domain IPs 104.18.6.37, 104.18.7.37, 2606:4700::6812:625, 2606:4700::6812:725
Redirect IPs 104.18.6.37, 104.18.7.37, 2606:4700::6812:625, 2606:4700::6812:725
Response IP 104.18.7.37
Found Yes
Hash 8f9b6e05e5cd031358e138d27957783f5dc6bc0f8e8fc83a9ee56bd99cde7255
SimHash 2855c546d645

Groups

*

Rule Path
Disallow /google/
Disallow /reviews/
Disallow /webmastertools/
Disallow /fir_news/
Disallow /webservices/
Disallow /Homepage/internet-shops.asp
Disallow /webshop/
Disallow /correct/
Disallow /webservices/
Disallow /ContactForm.aspx
Disallow /ContactForm2.aspx
Disallow /ContactForm.ashx
Disallow /uploadHandler.ashx
Disallow /userContent.ashx
Disallow /korrektur_firmendaten.asp
Disallow /s?
Disallow /ScriptResource.axd
Disallow /combinescriptshandler.axd
Disallow /WebResource.axd
Disallow /info/cookies_policy.html
Disallow /info/terms-and-conditions-customer-reviews.html
Disallow /info/terms-and-conditions-quote-requests.html
Disallow /api/
Disallow /map/*-route.html
Disallow /showCompanyMap
Disallow /cdn-cgi/
Disallow /claim-my-business
Disallow /delete-company-request

mediapartners-google

Rule Path
Allow /s?