stax.co.za
robots.txt

Robots Exclusion Standard data for stax.co.za

Resource Scan

Scan Details

Site Domain stax.co.za
Base Domain stax.co.za
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-14T05:37:29+00:00
Next Scan 2026-01-13T05:37:29+00:00

Last Successful Scan

Scanned2025-08-23T13:09:51+00:00
URL https://stax.co.za/robots.txt
Domain IPs 129.232.157.42
Response IP 129.232.157.42
Found Yes
Hash a6d967aaa223d3620774c56c51bf750d68127b9ec63ee88d5349b65b347eb337
SimHash 4900c8c041b1

Groups

*

Rule Path
Allow /wp-content/uploads/
Disallow /test/
Disallow /readme.html
Disallow /refer/

Other Records

Field Value
crawl-delay 20

Other Records

Field Value
sitemap https://www.stax.co.za/sitemap_index.xml

Warnings

  • 1 invalid line.