kaleidocode.co.za
robots.txt

Robots Exclusion Standard data for kaleidocode.co.za

Resource Scan

Scan Details

Site Domain kaleidocode.co.za
Base Domain kaleidocode.co.za
Scan Status Ok
Last Scan2025-11-01T15:24:08+00:00
Next Scan 2025-12-01T15:24:08+00:00

Last Scan

Scanned2025-11-01T15:24:08+00:00
URL https://kaleidocode.co.za/robots.txt
Redirect https://www.kaleidocode.co.za/robots.txt
Redirect Domain www.kaleidocode.co.za
Redirect Base kaleidocode.co.za
Domain IPs 199.34.228.65
Redirect IPs 199.34.228.65
Response IP 199.34.228.65
Found Yes
Hash 1421d14a9134fd96edd6bb9ca09fdd4b8f2f2c8796a41970b458d9a83d914184
SimHash 6334d8766f93

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /mobile.html
Disallow /apply-123-formbuilder.html
Disallow /junior-to-mid-level-test-engineer.html
Disallow /project-co-ordinator.html
Disallow /operational-administrator.html
Disallow /it-devops-engineer.html
Disallow /front-end-developers.html
Disallow /graduates.html

Other Records

Field Value
sitemap https://www.kaleidocode.co.za/sitemap.xml